00000001:02000400:2.0F:1787758798.547755:0:3093:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787758817.963879:0:3317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1787758820.180202:0:3368:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 382 MB/s 00000001:01000000:2.0:1787758820.431289:0:3368:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 653 MB/s 00000001:01000000:2.0:1787758820.681426:0:3368:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2167 MB/s 00000020:02000000:1.0F:1787758821.952208:0:3410:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_104_g734b157 00000400:02000000:2.0:1787758823.692152:0:3425:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.133@tcp [8/256/0/180] 00008000:02000000:3.0F:1787758828.870050:0:3575:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1787758890.139554:0:5180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787758904.551821:0:5929:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787758904.551828:0:5929:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1787758904.551829:0:5929:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787758904.553918:0:5929:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d1d7c6e0 00000080:02000400:1.0:1787758904.553932:0:5929:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787758904.578364:0:5929:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787758904.578379:0:5929:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787758904.578680:0:5929:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ed38b6c0) 00000020:00000080:2.0:1787758904.578699:0:5929:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787758904.666285:0:5929:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787758904.666376:0:5929:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1787758904.696389:0:5929:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787758904.696620:0:5929:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787758904.696630:0:5929:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787758904.696643:0:5929:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a77009127f04e90 00000020:01000004:1.0:1787758904.696651:0:5929:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787758904.696656:0:5929:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787758904.696661:0:5929:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d1d7c6e0 from MGS 00000020:01000004:1.0:1787758904.696667:0:5929:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787758904.696688:0:5929:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000029d30419) 00000020:00000080:1.0:1787758904.698309:0:5929:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787758904.698415:0:5929:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d1d7c6e0 from MGS, refs=2 00080000:01000000:1.0:1787758904.698424:0:5929:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787758904.698434:0:5929:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a77009127f04e9e 00000100:00100000:1.0:1787758904.698565:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787758904.698712:0:5929:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787758904.698718:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787758904.699507:0:5929:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787758904.699516:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787758904.701621:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787758904.701814:0:5929:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787758904.701821:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787758904.703510:0:5929:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787758904.703523:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787758904.704266:0:5929:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787758904.704282:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787758904.705123:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758904.705128:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758904.705130:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758904.705642:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758904.705644:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758904.705646:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758904.706561:0:5929:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787758904.711305:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787758904.955977:0:5929:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2543 MB/s 00000001:01000000:1.0:1787758905.205868:0:5929:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3483 MB/s 00000001:01000000:1.0:1787758905.456755:0:5929:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 500 MB/s 00000001:01000000:3.0:1787758905.706818:0:5929:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 483 MB/s 00080000:10000000:3.0:1787758905.717639:0:5929:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:0.0:1787758905.754035:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787758905.772174:0:5929:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787758905.775945:0:5944:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787758905.776064:0:5929:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787758905.776118:0:5929:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787758905.776996:0:5929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787758905.777030:0:5929:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787758905.779446:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787758905.781544:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787758905.781552:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787758905.785754:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787758905.785769:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787758905.787302:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787758905.787322:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787758905.801882:0:5929:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787758905.801919:0:5929:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.133@tcp' 00000020:01000004:0.0:1787758905.801921:0:5929:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787758905.801978:0:5929:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.133@tcp (typ=mgc) 00000020:00000080:0.0:1787758905.802005:0:5929:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.133@tcp (00000000151a243a) 00000020:00000080:0.0:1787758905.802025:0:5929:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787758905.802367:0:5929:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b802b28f@MGC192.168.204.133@tcp: add connection 192.168.204.133@tcp at head 00010000:00010000:0.0:1787758905.802790:0:5929:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.133@tcp-0 is initialized 00000040:01000000:0.0:1787758905.802797:0:5929:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.133@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787758905.804423:0:5949:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787758905.807171:0:5950:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787758905.807330:0:5929:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.133@tcp (uuid cb6a7c9f-0533-4587-8019-48dc39f7d1fe) 00000020:00000080:0.0:1787758905.807358:0:5929:0:(genops.c:1385:class_connect()) connect: client cb6a7c9f-0533-4587-8019-48dc39f7d1fe, cookie 0x1a77009127f04eac 00000100:00080000:0.0:1787758905.807376:0:5929:0:(import.c:510:import_select_connection()) MGC192.168.204.133@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787758905.807382:0:5929:0:(import.c:624:import_select_connection()) MGC192.168.204.133@tcp: import 00000000b802b28f using connection 192.168.204.133@tcp/0@lo 00000100:00100000:0.0:1787758905.807416:0:5929:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009b57e314 x1874600995586176/t0(0) o250->MGC192.168.204.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787758905.818413:0:5929:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cb6a7c9f-0533-4587-8019-48dc39f7d1fe->MGS 00000020:01000004:0.0:1787758905.818447:0:5929:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787758905.818455:0:5929:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787758905.818478:0:5929:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000fad97a1) 00000020:00000080:0.0:1787758905.818510:0:5929:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787758905.818779:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b57e314 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3440:1874600995586176:0@lo:250: 00000100:00100000:1.0:1787758905.818919:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758905.818996:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995586176 00000100:00100000:1.0:1787758905.819003:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995586176 00000100:00100000:1.0:1787758905.819037:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787758905.819046:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cae21b22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3440:x1874600995586176:12345-0@lo:250: 00010000:00080000:1.0:1787758905.819075:0:5946:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from cb6a7c9f-0533-4587-8019-48dc39f7d1fe@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:1.0:1787758905.819098:0:5946:0:(genops.c:1385:class_connect()) connect: client cb6a7c9f-0533-4587-8019-48dc39f7d1fe, cookie 0x1a77009127f04eba 00000100:00080000:1.0:1787758905.819309:0:5946:0:(import.c:65:import_set_state_nolock()) 0000000048d3e111 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787758905.819370:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cae21b22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+5:3440:x1874600995586176:12345-0@lo:250: Request processed in 324us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758905.819378:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787758905.819425:0:3440:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.133@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787758905.819433:0:3440:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.133@tcp: connect to target with instance 0 00000100:00080000:1.0:1787758905.819450:0:3440:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.133@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787758905.819454:0:3440:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787758905.819457:0:3440:0:(import.c:65:import_set_state_nolock()) 00000000b802b28f MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787758905.819459:0:3440:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787758905.819470:0:3440:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787758905.819474:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b57e314 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3440:1874600995586176:0@lo:250: 00000100:00100000:0.0:1787758905.856760:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787758905.857344:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787758905.857351:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787758905.858414:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787758905.858423:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787758905.858952:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787758905.858959:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787758905.860323:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787758905.860494:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787758905.860622:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787758905.862451:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787758905.862461:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787758906.001376:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787758906.001745:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787758906.001752:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787758906.004516:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787758906.004530:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787758906.005343:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787758906.005683:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787758906.005689:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787758906.006741:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787758906.006754:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787758906.007890:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787758906.008383:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787758906.008399:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787758906.009129:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787758906.009146:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787758906.010053:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787758906.010476:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787758906.010483:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787758906.023037:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787758906.023055:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787758906.078686:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787758906.079167:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787758906.079176:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787758906.088793:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787758906.088810:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787758906.092742:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787758906.092758:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787758906.095962:0:5929:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787758906.096061:0:5929:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787758906.096069:0:5929:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.133@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787758906.096174:0:5929:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.133@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787758906.096291:0:5929:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.133@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787758906.096296:0:5929:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787758906.096299:0:5929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787758906.096300:0:5929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758906.096301:0:5929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787758906.096302:0:5929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758906.096303:0:5929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758906.096305:0:5929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787758906.096306:0:5929:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787758906.096307:0:5929:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787758906.096308:0:5929:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787758906.096310:0:5929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758906.096311:0:5929:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787758906.096314:0:5929:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787758906.096317:0:5929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787758906.096318:0:5929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787758906.096318:0:5929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758906.096319:0:5929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787758906.096320:0:5929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758906.096321:0:5929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758906.096322:0:5929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787758906.096323:0:5929:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787758906.096324:0:5929:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787758906.096325:0:5929:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787758906.096326:0:5929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758906.096326:0:5929:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787758906.096355:0:5929:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787758906.096372:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b57e314 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995586304:0@lo:253: 00000100:00100000:0.0:1787758906.096459:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758906.096612:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e8f67de going to sleep for 11 seconds 00000100:00100000:2.0:1787758906.096664:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995586304 00000100:00100000:2.0:1787758906.096671:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995586304 00000100:00100000:2.0:1787758906.096745:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787758906.096754:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089c3f8e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+5:5929:x1874600995586304:12345-0@lo:253: 20000000:01000000:2.0:1787758906.096797:0:5948:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787758906.096800:0:5948:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787758906.097129:0:5969:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787758906.097176:0:5948:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787758906.097467:0:5948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787758906.098473:0:5970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787758906.098789:0:5948:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787758906.098793:0:5948:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787758906.098798:0:5948:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787758906.098802:0:5948:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787758906.098812:0:5948:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787758906.098979:0:5948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787758906.099154:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787758906.099168:0:5948:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787758906.099185:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787758906.099304:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787758906.099339:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787758906.099390:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787758906.099396:0:5948:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787758906.099407:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787758906.099411:0:5948:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787758906.099421:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787758906.099424:0:5948:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787758906.099434:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787758906.099447:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787758906.099470:0:5948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787758906.099474:0:5948:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787758906.099481:0:5948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787758906.099729:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787758906.099739:0:5948:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787758906.099755:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787758906.099770:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787758906.099783:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787758906.099791:0:5948:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787758906.099823:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787758906.099832:0:5948:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787758906.099995:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787758906.100013:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787758906.100026:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787758906.100034:0:5948:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787758906.100058:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787758906.100064:0:5948:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787758906.100077:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787758906.100106:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787758906.100170:0:5948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787758906.100192:0:5948:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787758906.100387:0:5948:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787758906.100813:0:5971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787758906.101135:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787758906.101159:0:5948:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.133@tcp for mdt 20000000:01000000:0.0:1787758906.101161:0:5948:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.133@tcp (null) (null) (null) 00000040:00080000:0.0:1787758906.101176:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787758906.101182:0:5948:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787758906.101278:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787758906.101286:0:5948:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.133@tcp (null) (null) 00000040:00080000:0.0:1787758906.101303:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787758906.101310:0:5948:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787758906.101324:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787758906.101338:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787758906.101368:0:5948:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787758906.101371:0:5948:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787758906.101375:0:5948:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787758906.101440:0:5948:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787758906.101442:0:5948:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787758906.101998:0:5972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787758906.102179:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787758906.102289:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787758906.102319:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1787758906.102330:0:5948:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787758906.102333:0:5948:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787758906.104338:0:5973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787758906.104525:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787758906.104552:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787758906.104568:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1787758906.104578:0:5948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787758906.104581:0:5948:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787758906.104585:0:5948:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787758906.104587:0:5948:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787758906.104592:0:5948:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787758906.104599:0:5948:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787758906.105126:0:5974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787758906.105366:0:5948:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787758906.111238:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787758906.111282:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787758906.111300:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787758906.111325:0:5948:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787758906.111350:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000003974943/0x1a77009127f04ec1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.111368:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003974943/0x1a77009127f04ec1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.111392:0:5948:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000003974943/0x1a77009127f04ec1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.111398:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000003974943/0x1a77009127f04ec1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.111404:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000003974943/0x1a77009127f04ec1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.111410:0:5948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000003974943/0x1a77009127f04ec1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.111416:0:5948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000003974943 already unused, calling callback (000000003aa1823c) 00010000:00010000:2.0:1787758906.111420:0:5948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000003974943/0x1a77009127f04ec1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.111427:0:5948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000003974943/0x1a77009127f04ec1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.111441:0:5948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000003974943/0x1a77009127f04ec1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.111448:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000003974943/0x1a77009127f04ec1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.111454:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000003974943/0x1a77009127f04ec1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787758906.111477:0:5948:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787758906.117677:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089c3f8e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+5:5929:x1874600995586304:12345-0@lo:253: Request processed in 20913us (21208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758906.117695:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787758906.117794:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b57e314 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995586304:0@lo:253: 10000000:01000000:0.0:1787758906.117810:0:5929:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787758906.117813:0:5929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787758906.117815:0:5929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787758906.117816:0:5929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758906.117817:0:5929:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787758906.117818:0:5929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758906.117819:0:5929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758906.117821:0:5929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787758906.117822:0:5929:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787758906.117824:0:5929:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787758906.117825:0:5929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758906.117826:0:5929:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787758906.117960:0:5929:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d1d7c6e0 from lustre-MDT0000 10000000:01000000:0.0:1787758906.117994:0:5929:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787758906.117998:0:5929:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787758906.118003:0:5929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88b300e3ced8 10000000:01000000:0.0:1787758906.118007:0:5929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787758906.118015:0:5929:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88b300e3ced8 from 1 10000000:01000000:0.0:1787758906.118027:0:5929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787758906.118063:0:5929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 000000000ad1915d/0x1a77009127f04ec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.118073:0:5929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 000000000ad1915d/0x1a77009127f04ec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.118082:0:5929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 000000000ad1915d/0x1a77009127f04ec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758906.118100:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b57e314 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995586432:0@lo:101: 00000100:00100000:0.0:1787758906.118138:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758906.118221:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aca27d87 going to sleep for 11 seconds 00000100:00100000:1.0:1787758906.118272:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995586432 00000100:00100000:1.0:1787758906.118279:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995586432 00000100:00100000:1.0:1787758906.118349:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787758906.118357:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d58a1ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+5:5929:x1874600995586432:12345-0@lo:101: 00010000:00010000:1.0:1787758906.118370:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758906.118383:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000957a2076/0x1a77009127f04ecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f04ec8 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758906.118405:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000957a2076/0x1a77009127f04ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f04ec8 expref: 6 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758906.118414:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000957a2076/0x1a77009127f04ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04ec8 expref: 6 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758906.118423:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000957a2076, rc 0) 00000100:00100000:1.0:1787758906.118466:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d58a1ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+6:5929:x1874600995586432:12345-0@lo:101: Request processed in 109us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758906.118479:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787758906.118633:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b57e314 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995586432:0@lo:101: 00010000:00010000:2.0:1787758906.118654:0:5929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 000000000ad1915d/0x1a77009127f04ec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04ecf expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.118662:0:5929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 000000000ad1915d/0x1a77009127f04ec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f04ecf expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758906.118711:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995586560:0@lo:501: 00000100:00100000:2.0:1787758906.118762:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.119067:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f5cbdfa going to sleep for 11 seconds 00000100:00100000:0.0:1787758906.119098:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995586560 00000100:00100000:0.0:1787758906.119103:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995586560 00000100:00100000:0.0:1787758906.119128:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787758906.119133:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c9f846c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+6:5929:x1874600995586560:12345-0@lo:501: 00000100:00100000:0.0:1787758906.119255:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c9f846c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+6:5929:x1874600995586560:12345-0@lo:501: Request processed in 121us (492us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787758906.119262:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787758906.119376:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995586560:0@lo:501: 10000000:01000000:2.0:1787758906.119406:0:5929:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787758906.119424:0:5929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: 000000000ad1915d/0x1a77009127f04ec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04ecf expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.119431:0:5929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: 000000000ad1915d/0x1a77009127f04ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04ecf expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758906.119439:0:5929:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88b2e05c4000 10000000:01000000:2.0:1787758906.119442:0:5929:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787758906.119446:0:5929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88b2e05c4000 10000000:01000000:2.0:1787758906.119448:0:5929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787758906.119450:0:5929:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88b2e05c4000 from 1 10000000:01000000:2.0:1787758906.119452:0:5929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787758906.119470:0:5929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 00000000fecbdee2/0x1a77009127f04ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.119476:0:5929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 00000000fecbdee2/0x1a77009127f04ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.119494:0:5929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 00000000fecbdee2/0x1a77009127f04ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758906.119505:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995586688:0@lo:101: 00000100:00100000:2.0:1787758906.119529:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.119541:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f5cbdfa going to sleep for 11 seconds 00000100:00100000:0.0:1787758906.119591:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995586688 00000100:00100000:0.0:1787758906.119596:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995586688 00000100:00100000:0.0:1787758906.119615:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787758906.119620:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e9187f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+6:5929:x1874600995586688:12345-0@lo:101: 00010000:00010000:0.0:1787758906.119628:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758906.119642:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000090348fdf/0x1a77009127f04edd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f04ed6 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.119656:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000090348fdf/0x1a77009127f04edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f04ed6 expref: 7 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.119671:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000090348fdf/0x1a77009127f04edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04ed6 expref: 7 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.119676:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000090348fdf, rc 0) 00000100:00100000:0.0:1787758906.119709:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e9187f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+7:5929:x1874600995586688:12345-0@lo:101: Request processed in 90us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758906.119715:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787758906.119780:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995586688:0@lo:101: 00010000:00010000:2.0:1787758906.119789:0:5929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 00000000fecbdee2/0x1a77009127f04ed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04edd expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.119796:0:5929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 00000000fecbdee2/0x1a77009127f04ed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f04edd expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758906.119806:0:5929:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787758906.119938:0:5929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: 00000000fecbdee2/0x1a77009127f04ed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04edd expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.119946:0:5929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: 00000000fecbdee2/0x1a77009127f04ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04edd expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758906.119952:0:5929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787758906.119955:0:5929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787758906.119959:0:5929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88b2e05c4000 10000000:01000000:2.0:1787758906.119961:0:5929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787758906.119964:0:5929:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787758906.119966:0:5929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787758906.119979:0:5929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 00000000697aa265/0x1a77009127f04ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.119990:0:5929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 00000000697aa265/0x1a77009127f04ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.119996:0:5929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 00000000697aa265/0x1a77009127f04ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758906.120008:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995586816:0@lo:101: 00000100:00100000:2.0:1787758906.120032:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.120046:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f5cbdfa going to sleep for 11 seconds 00000100:00100000:1.0:1787758906.120092:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995586816 00000100:00100000:1.0:1787758906.120096:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995586816 00000100:00100000:1.0:1787758906.120118:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787758906.120123:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002605b5a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+7:5929:x1874600995586816:12345-0@lo:101: 00010000:00010000:1.0:1787758906.120129:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758906.120136:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b498a5d5/0x1a77009127f04eeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f04ee4 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758906.120149:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b498a5d5/0x1a77009127f04eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f04ee4 expref: 8 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758906.120156:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b498a5d5/0x1a77009127f04eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04ee4 expref: 8 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758906.120160:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b498a5d5, rc 0) 00000100:00100000:1.0:1787758906.120196:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002605b5a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+8:5929:x1874600995586816:12345-0@lo:101: Request processed in 72us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758906.120202:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787758906.120312:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995586816:0@lo:101: 00010000:00010000:2.0:1787758906.120321:0:5929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 00000000697aa265/0x1a77009127f04ee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04eeb expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.120327:0:5929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 00000000697aa265/0x1a77009127f04ee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f04eeb expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758906.120367:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995586944:0@lo:501: 00000100:00100000:2.0:1787758906.120390:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.120411:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f5cbdfa going to sleep for 11 seconds 00000100:00100000:1.0:1787758906.120515:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995586944 00000100:00100000:1.0:1787758906.120520:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995586944 00000100:00100000:1.0:1787758906.120540:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787758906.120545:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f0179c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+8:5929:x1874600995586944:12345-0@lo:501: 00000100:00100000:1.0:1787758906.120654:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f0179c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+9:5929:x1874600995586944:12345-0@lo:501: Request processed in 109us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758906.120660:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787758906.120788:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995586944:0@lo:501: 00000100:00100000:2.0:1787758906.120813:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995587072:0@lo:503: 00000100:00100000:2.0:1787758906.120925:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.120976:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f5cbdfa going to sleep for 11 seconds 00000100:00100000:1.0:1787758906.121096:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995587072 00000100:00100000:1.0:1787758906.121101:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995587072 00000100:00100000:1.0:1787758906.121164:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787758906.121170:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f0fac86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+9:5929:x1874600995587072:12345-0@lo:503: 00000100:00100000:1.0:1787758906.121358:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f0fac86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+9:5929:x1874600995587072:12345-0@lo:503: Request processed in 188us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758906.121364:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787758906.121411:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995587072:0@lo:503: 00000100:00100000:1.0:1787758906.121720:0:5975:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec6762ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5975:1874600995587200:0@lo:502: 00000100:00100000:1.0:1787758906.121745:0:5975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758906.121787:0:5975:0:(client.c:2715:ptlrpc_set_wait()) set 000000005271e8a4 going to sleep for 11 seconds 00000100:00100000:2.0:1787758906.121825:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995587200 00000100:00100000:2.0:1787758906.121835:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995587200 00000100:00100000:2.0:1787758906.122013:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787758906.122020:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b53b96e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+9:5975:x1874600995587200:12345-0@lo:502: 00000100:00100000:2.0:1787758906.122151:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b53b96e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+9:5975:x1874600995587200:12345-0@lo:502: Request processed in 132us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758906.122158:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787758906.122211:0:5975:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec6762ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5975:1874600995587200:0@lo:502: 00000020:01000000:1.0:1787758906.122244:0:5975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787758906.122256:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758906.122258:0:5975:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787758906.122264:0:5975:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787758906.122266:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787758906.122351:0:5975:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000004941b9a8) 00000020:00000080:1.0:1787758906.122376:0:5975:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787758906.122384:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787758906.122452:0:5975:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787758906.122459:0:5975:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a77009127f04ef9 00000020:00000080:1.0:1787758906.122694:0:5975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787758906.122698:0:5975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787758906.122701:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758906.122702:0:5975:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787758906.122705:0:5975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787758906.122708:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758906.122709:0:5975:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787758906.122711:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787758906.122717:0:5975:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000f2b85293) 00000020:00000080:1.0:1787758906.122726:0:5975:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787758906.122729:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787758906.122734:0:5975:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787758906.122737:0:5975:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787758906.122743:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787758906.122799:0:5975:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d1d7c6e0 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787758906.122810:0:5975:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a228a70e) 00000020:00000080:1.0:1787758906.122817:0:5975:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787758906.123075:0:5975:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787758906.123081:0:5975:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a77009127f04f0e 00000020:00000080:1.0:1787758906.123192:0:5975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787758906.123198:0:5975:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787758906.123204:0:5975:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1a77009127f04f15 00080000:01000000:1.0:1787758906.123208:0:5975:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787758906.123211:0:5975:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a77009127f04f1c 00080000:10000000:1.0:1787758906.124194:0:5975:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787758906.124429:0:5975:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787758906.128671:0:5975:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1787758906.257112:0:5975:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1787758906.257733:0:5975:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1787758906.265497:0:5975:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787758906.266093:0:5975:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787758906.270536:0:5975:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000048afe134) 00000020:00000080:0.0:1787758906.270559:0:5975:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787758906.270641:0:5975:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787758906.270648:0:5975:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a77009127f04f2a 00000020:00000080:1.0:1787758906.284377:0:5975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787758906.285645:0:5975:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1787758906.290653:0:5975:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1787758906.293374:0:5975:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1787758906.296174:0:5975:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1787758906.299325:0:5975:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1787758906.304883:0:5975:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1787758906.308493:0:5975:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1a77009127f04f31 00000020:00000080:1.0:1787758906.309523:0:5975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787758906.309535:0:5975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787758906.309590:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758906.309593:0:5975:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787758906.309598:0:5975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787758906.309603:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758906.309604:0:5975:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787758906.309607:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787758906.309609:0:5975:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787758906.309612:0:5975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787758906.309614:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758906.309615:0:5975:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787758906.309617:0:5975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787758906.309622:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758906.309623:0:5975:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787758906.309627:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787758906.309695:0:5975:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787758906.309760:0:5975:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5975:1874600995587328:0@lo:502: 00000100:00100000:2.0:1787758906.310172:0:5975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.310298:0:5975:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4544553 going to sleep for 11 seconds 00000100:00100000:1.0:1787758906.310380:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995587328 00000100:00100000:1.0:1787758906.310394:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995587328 00000100:00100000:1.0:1787758906.310433:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787758906.310441:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006704a417 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+9:5975:x1874600995587328:12345-0@lo:502: 00000100:00100000:1.0:1787758906.310564:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006704a417 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+9:5975:x1874600995587328:12345-0@lo:502: Request processed in 123us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758906.310572:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787758906.310709:0:5975:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5975:1874600995587328:0@lo:502: 00000020:01000000:2.0:1787758906.310738:0:5975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787758906.310743:0:5975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758906.310744:0:5975:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787758906.310747:0:5975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787758906.311294:0:5929:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787758906.311315:0:5929:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787758906.311331:0:5929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: 00000000697aa265/0x1a77009127f04ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04eeb expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.311343:0:5929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: 00000000697aa265/0x1a77009127f04ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04eeb expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758906.311352:0:5929:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88b2e05c4000 from 1 10000000:01000000:0.0:1787758906.311355:0:5929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787758906.311388:0:5929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.311395:0:5929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.311404:0:5929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758906.311433:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025ba0433 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995587456:0@lo:101: 00000100:00100000:0.0:1787758906.311474:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758906.311510:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 000000003c5a0cf5 going to sleep for 11 seconds 00000100:00100000:1.0:1787758906.311590:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995587456 00000100:00100000:1.0:1787758906.311596:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995587456 00000100:00100000:1.0:1787758906.311631:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787758906.311637:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080e6f4c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+9:5929:x1874600995587456:12345-0@lo:101: 00010000:00010000:1.0:1787758906.311646:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758906.311658:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004cb8ad8f/0x1a77009127f04f3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f04f38 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758906.311681:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004cb8ad8f/0x1a77009127f04f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f04f38 expref: 10 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758906.311691:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004cb8ad8f/0x1a77009127f04f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04f38 expref: 10 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758906.311699:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004cb8ad8f, rc 0) 00000100:00100000:1.0:1787758906.311741:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080e6f4c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+10:5929:x1874600995587456:12345-0@lo:101: Request processed in 104us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758906.311747:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787758906.312189:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025ba0433 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995587456:0@lo:101: 00010000:00010000:2.0:1787758906.312450:0:5929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f3f expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.312459:0:5929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f04f3f expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758906.313807:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995587584:0@lo:256: 00000100:00100000:2.0:1787758906.314179:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.314338:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4544553 going to sleep for 11 seconds 00000100:00100000:0.0:1787758906.314397:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995587584 00000100:00100000:0.0:1787758906.314405:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995587584 00000100:00100000:0.0:1787758906.314457:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787758906.314466:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e9cc6d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+10:5929:x1874600995587584:12345-0@lo:256: 20000000:01000000:0.0:1787758906.314488:0:5947:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787758906.314493:0:5947:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787758906.314704:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e9cc6d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+10:5929:x1874600995587584:12345-0@lo:256: Request processed in 239us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758906.314711:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787758906.314780:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995587584:0@lo:256: 10000000:01000000:2.0:1787758906.316171:0:5929:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787758906.316319:0:5929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f3f expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.316331:0:5929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f3f expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758906.316340:0:5929:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b2e05c4000 from 1 10000000:01000000:2.0:1787758906.316343:0:5929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787758906.316383:0:5929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.316391:0:5929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.316401:0:5929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758906.316435:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995587712:0@lo:101: 00000100:00100000:2.0:1787758906.316486:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.316528:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4544553 going to sleep for 11 seconds 00000100:00100000:1.0:1787758906.316640:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995587712 00000100:00100000:1.0:1787758906.316648:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995587712 00000100:00100000:1.0:1787758906.316698:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787758906.316706:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e91670f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+10:5929:x1874600995587712:12345-0@lo:101: 00010000:00010000:1.0:1787758906.316719:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758906.316738:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000597d7d68/0x1a77009127f04f4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f04f46 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758906.316759:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000597d7d68/0x1a77009127f04f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f04f46 expref: 11 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758906.316769:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000597d7d68/0x1a77009127f04f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04f46 expref: 11 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758906.316778:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000597d7d68, rc 0) 00000100:00100000:1.0:1787758906.316834:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e91670f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:5929:x1874600995587712:12345-0@lo:101: Request processed in 129us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758906.316868:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787758906.317161:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995587712:0@lo:101: 00010000:00010000:3.0:1787758906.317177:0:5929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f4d expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758906.317211:0:5929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f04f4d expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758906.317288:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086c171d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995587840:0@lo:501: 00000100:00100000:3.0:1787758906.317319:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758906.317351:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 000000001359a893 going to sleep for 11 seconds 00000100:00100000:1.0:1787758906.317529:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995587840 00000100:00100000:1.0:1787758906.317534:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995587840 00000100:00100000:1.0:1787758906.317573:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787758906.317581:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d66b1fed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:5929:x1874600995587840:12345-0@lo:501: 00000100:00100000:1.0:1787758906.317756:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d66b1fed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:5929:x1874600995587840:12345-0@lo:501: Request processed in 175us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758906.317765:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787758906.318166:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086c171d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995587840:0@lo:501: 00000100:00100000:3.0:1787758906.318215:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086c171d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995587968:0@lo:503: 00000100:00100000:3.0:1787758906.318272:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758906.318302:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 000000001359a893 going to sleep for 11 seconds 00000100:00100000:2.0:1787758906.318355:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995587968 00000100:00100000:2.0:1787758906.318360:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995587968 00000100:00100000:2.0:1787758906.318391:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787758906.318398:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087a832ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:5929:x1874600995587968:12345-0@lo:503: 00000040:00080000:2.0:1787758906.318435:0:5948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787758906.318481:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087a832ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:5929:x1874600995587968:12345-0@lo:503: Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758906.318488:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787758906.318665:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086c171d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995587968:0@lo:503: 00000040:00080000:3.0:1787758906.322596:0:5979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787758906.325303:0:5929:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787758906.325342:0:5929:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787758906.325367:0:5929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f4d expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.325382:0:5929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f4d expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758906.325443:0:5929:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787758906.325446:0:5929:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88b2e05c4000 10000000:01000000:2.0:1787758906.325449:0:5929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88b2e05c4000 10000000:01000000:2.0:1787758906.325453:0:5929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787758906.325459:0:5929:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b2e05c4000 from 1 10000000:01000000:2.0:1787758906.325462:0:5929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787758906.325497:0:5929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 00000000eb1c307d/0x1a77009127f04f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.325522:0:5929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 00000000eb1c307d/0x1a77009127f04f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.325533:0:5929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 00000000eb1c307d/0x1a77009127f04f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758906.325556:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b74ccdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995588096:0@lo:101: 00000100:00100000:2.0:1787758906.325629:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.325680:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd5e6e5f going to sleep for 11 seconds 00000100:00100000:3.0:1787758906.325812:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995588096 00000100:00100000:3.0:1787758906.325820:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995588096 00000100:00100000:3.0:1787758906.325902:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787758906.325910:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ad030ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:5929:x1874600995588096:12345-0@lo:101: 00010000:00010000:3.0:1787758906.325923:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758906.325934:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c2527e2c/0x1a77009127f04f5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f04f54 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758906.325965:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c2527e2c/0x1a77009127f04f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f04f54 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758906.325975:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c2527e2c/0x1a77009127f04f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04f54 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758906.325993:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c2527e2c, rc 0) 00000100:00100000:3.0:1787758906.326031:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ad030ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5929:x1874600995588096:12345-0@lo:101: Request processed in 122us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758906.326038:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787758906.326450:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b74ccdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995588096:0@lo:101: 00010000:00010000:2.0:1787758906.326464:0:5929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 00000000eb1c307d/0x1a77009127f04f54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f5b expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.326472:0:5929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 00000000eb1c307d/0x1a77009127f04f54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f04f5b expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758906.326529:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b74ccdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995588224:0@lo:501: 00000100:00100000:2.0:1787758906.326556:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.326578:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd5e6e5f going to sleep for 11 seconds 00000100:00100000:1.0:1787758906.328317:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995588224 00000100:00100000:1.0:1787758906.328328:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995588224 00000100:00100000:1.0:1787758906.328419:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787758906.328429:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c49c049 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5929:x1874600995588224:12345-0@lo:501: 00000100:00100000:1.0:1787758906.328591:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c49c049 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5929:x1874600995588224:12345-0@lo:501: Request processed in 164us (2034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758906.328599:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787758906.328672:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b74ccdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995588224:0@lo:501: 00000100:00100000:2.0:1787758906.328716:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b74ccdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995588352:0@lo:503: 00000100:00100000:2.0:1787758906.328762:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.331879:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd5e6e5f going to sleep for 11 seconds 00000100:00100000:3.0:1787758906.332834:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995588352 00000100:00100000:3.0:1787758906.335719:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995588352 00000100:00100000:3.0:1787758906.335788:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787758906.335796:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007352536d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5929:x1874600995588352:12345-0@lo:503: 00000100:00100000:3.0:1787758906.336197:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007352536d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5929:x1874600995588352:12345-0@lo:503: Request processed in 393us (7425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758906.336205:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787758906.337374:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b74ccdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995588352:0@lo:503: 00000100:00100000:3.0:1787758906.337790:0:5980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086c171d5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5980:1874600995588480:0@lo:502: 00000100:00100000:3.0:1787758906.338337:0:5980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.338489:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995588480 00000100:00100000:2.0:1787758906.338501:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995588480 00000100:00100000:2.0:1787758906.338572:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787758906.338581:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090b9db41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5980:x1874600995588480:12345-0@lo:502: 00000100:00100000:2.0:1787758906.338690:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090b9db41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5980:x1874600995588480:12345-0@lo:502: Request processed in 111us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758906.338696:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787758906.339150:0:5980:0:(client.c:2715:ptlrpc_set_wait()) set 00000000813ccc0f going to sleep for 11 seconds 00000100:00100000:2.0:1787758906.339171:0:5980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086c171d5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5980:1874600995588480:0@lo:502: 00000020:01000004:2.0:1787758906.339300:0:5980:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787758906.339314:0:5980:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000055d39027) 00000020:00000080:2.0:1787758906.339332:0:5980:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787758906.339412:0:5980:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d1d7c6e0 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787758906.339416:0:5980:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d1d7c6e0 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787758906.339418:0:5980:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d1d7c6e0 4 00010000:00080000:2.0:1787758906.339446:0:5980:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000efdd8882@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.133@tcp at head 00010000:00010000:2.0:1787758906.341796:0:5980:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787758906.342672:0:5980:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787758906.342715:0:5980:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787758906.342728:0:5980:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1a77009127f04f69 00000100:00080000:2.0:1787758906.342741:0:5980:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787758906.342745:0:5980:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000efdd8882 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:2.0:1787758906.342780:0:5980:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005b74ccdd x1874600995588608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787758906.342810:0:5980:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787758906.343019:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b74ccdd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3440:1874600995588608:0@lo:38: 00000100:00100000:3.0:1787758906.343116:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.343415:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995588608 00000100:00100000:2.0:1787758906.343422:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995588608 00000100:00100000:2.0:1787758906.343460:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787758906.343466:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069048696 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3440:x1874600995588608:12345-0@lo:38: 00000100:00100000:2.0:1787758906.343540:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069048696 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3440:x1874600995588608:12345-0@lo:38: Request processed in 73us (425us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787758906.343547:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787758906.343587:0:3440:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787758906.343593:0:3440:0:(import.c:65:import_set_state_nolock()) 00000000efdd8882 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787758906.343597:0:3440:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787758906.343600:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b74ccdd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3440:1874600995588608:0@lo:38: 00000100:00100000:2.0:1787758906.354548:0:5980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b74ccdd pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5980:1874600995588736:0@lo:502: 00000100:00100000:2.0:1787758906.354638:0:5980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.354679:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995588736 00000100:00100000:2.0:1787758906.354685:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995588736 00000100:00100000:2.0:1787758906.354734:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787758906.354743:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043e9d1bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5980:x1874600995588736:12345-0@lo:502: 00000100:00100000:2.0:1787758906.354878:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043e9d1bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5980:x1874600995588736:12345-0@lo:502: Request processed in 137us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758906.354886:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787758906.354936:0:5980:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069137564 going to sleep for 11 seconds 00000100:00100000:2.0:1787758906.354958:0:5980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b74ccdd pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5980:1874600995588736:0@lo:502: 00000040:00080000:2.0:1787758906.354986:0:5980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787758906.355056:0:5929:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787758906.355075:0:5929:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787758906.355089:0:5929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: 00000000eb1c307d/0x1a77009127f04f54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f5b expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.355100:0:5929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: 00000000eb1c307d/0x1a77009127f04f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f5b expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787758906.355163:0:5929:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787758906.355165:0:5929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787758906.355166:0:5929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787758906.355168:0:5929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787758906.355169:0:5929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787758906.355171:0:5929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787758906.355172:0:5929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787758906.355174:0:5929:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787758906.355175:0:5929:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787758906.355176:0:5929:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787758906.355177:0:5929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787758906.355179:0:5929:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787758906.355182:0:5929:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787758906.355184:0:5929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787758906.355185:0:5929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787758906.355186:0:5929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787758906.355187:0:5929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787758906.355188:0:5929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787758906.355189:0:5929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787758906.357188:0:5929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787758906.357269:0:5929:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787758906.357270:0:5929:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787758906.357272:0:5929:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787758906.357273:0:5929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787758906.357274:0:5929:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787758906.357308:0:5929:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787758906.357325:0:5929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b74ccdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995588864:0@lo:253: 00000100:00100000:2.0:1787758906.357388:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.357434:0:5929:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025d53ae2 going to sleep for 11 seconds 00000100:00100000:0.0:1787758906.357732:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995588864 00000100:00100000:0.0:1787758906.357739:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995588864 00000100:00100000:0.0:1787758906.357788:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787758906.357796:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fbb416c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5929:x1874600995588864:12345-0@lo:253: 20000000:01000000:0.0:1787758906.357821:0:5946:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787758906.357835:0:5946:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787758906.367147:0:5946:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787758906.367268:0:5946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787758906.367647:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fbb416c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5929:x1874600995588864:12345-0@lo:253: Request processed in 9848us (10255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758906.367661:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 20000000:01000000:2.0:1787758906.367734:0:5969:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787758906.367739:0:5969:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787758906.367757:0:5969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.367773:0:5969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004cb8ad8f/0x1a77009127f04f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04f38 expref: 11 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.367794:0:5969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.367833:0:5969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004cb8ad8f/0x1a77009127f04f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f04f38 expref: 11 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.369546:0:5969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004cb8ad8f/0x1a77009127f04f3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f04f38 expref: 11 pid: 5948 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758906.369564:0:5969:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5969:1874600995588992:0@lo:104: 00000100:00100000:2.0:1787758906.369624:0:5969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758906.369671:0:5969:0:(client.c:2715:ptlrpc_set_wait()) set 000000007fe318bd going to sleep for 11 seconds 00000100:00100000:0.0:1787758906.370504:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995588992 00000100:00100000:0.0:1787758906.370514:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995588992 00000100:00100000:0.0:1787758906.370566:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787758906.370573:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d09861a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:5969:x1874600995588992:12345-0@lo:104: 00010000:00010000:0.0:1787758906.370603:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04f3f expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.370706:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787758906.370712:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d09861a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:5969:x1874600995588992:12345-0@lo:104: Request processed in 140us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758906.370719:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787758906.370810:0:5969:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc1eecfb pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5969:1874600995588992:0@lo:104: 00010000:00010000:1.0:1787758906.370835:0:5969:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.371312:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787758906.371319:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04f3f expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.371328:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005349851b already unused, calling callback (000000003ce86fe9) 10000000:00010000:0.0:1787758906.371331:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f04f3f expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.371339:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f04f3f expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758906.371345:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f04f3f expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758906.371350:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787758906.371397:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f3f expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.371404:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758906.371420:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f3f expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.371427:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: 000000005349851b/0x1a77009127f04f38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f3f expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758906.371449:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758906.371451:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758906.371452:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758906.371511:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d276d6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995589120:0@lo:103: 00000100:00100000:0.0:1787758906.371552:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758906.372408:0:5929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b74ccdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5929:1874600995588864:0@lo:253: 10000000:01000000:3.0:1787758906.372424:0:5929:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787758906.372426:0:5929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787758906.372428:0:5929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787758906.372430:0:5929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787758906.372431:0:5929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787758906.372432:0:5929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787758906.372433:0:5929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787758906.372434:0:5929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787758906.372435:0:5929:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787758906.372437:0:5929:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787758906.372438:0:5929:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787758906.372440:0:5929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787758906.372451:0:5929:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787758906.372466:0:5929:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787758906.373315:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995589120 00000100:00100000:2.0:1787758906.373323:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995589120 00010000:00010000:2.0:1787758906.373354:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004cb8ad8f/0x1a77009127f04f3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04f38 expref: 12 pid: 5948 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758906.373434:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787758906.373443:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000190f33e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:3442:x1874600995589120:12345-0@lo:103: 00010000:00010000:2.0:1787758906.373457:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787758906.373462:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004cb8ad8f/0x1a77009127f04f3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04f38 expref: 12 pid: 5948 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.373472:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004cb8ad8f/0x1a77009127f04f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f04f38 expref: 12 pid: 5948 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.373489:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004cb8ad8f/0x1a77009127f04f3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f04f38 expref: 12 pid: 5948 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.373518:0:5938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.373525:0:5938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787758906.373540:0:5938:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005801782s 00010000:00010000:2.0:1787758906.373544:0:5938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.373550:0:5938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.373555:0:5938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.373560:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.373566:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dc97988f already unused, calling callback (000000003aa1823c) 00010000:00010000:2.0:1787758906.373569:0:5938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.373577:0:5938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.373597:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758906.373607:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787758906.373678:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000190f33e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:3442:x1874600995589120:12345-0@lo:103: Request processed in 236us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758906.373685:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787758906.373737:0:5969:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758906.373746:0:5969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758906.373751:0:5969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dc97988f/0x1a77009127f04f70 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758906.377034:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d276d6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995589120:0@lo:103: 00080000:10000000:3.0:1787758906.379517:0:5929:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1787758906.379694:0:5929:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787758906.380483:0:5929:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1787758906.380682:0:5929:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787758906.381142:0:5929:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1787758906.381754:0:5929:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1787758906.384173:0:5929:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1787758906.384372:0:5929:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1787758906.384580:0:5929:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1787758906.384746:0:5929:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1787758906.385492:0:5929:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1787758906.385646:0:5929:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1787758906.393620:0:5929:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787758906.404168:0:5929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787758906.404821:0:5986:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787758906.407554:0:5929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000020:00080000:2.0:1787758906.407687:0:5985:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787758906.407714:0:5985:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1787758906.410759:0:5986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787758906.411600:0:5929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787758906.412311:0:5929:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787758906.412330:0:5929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787758906.416097:0:5929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787758906.418937:0:5929:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787758906.419806:0:5929:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787758906.419889:0:5929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787758906.420723:0:5929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787758906.421274:0:5929:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1787758906.425252:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787758906.425521:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787758906.425648:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787758906.425767:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787758906.426144:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787758906.426298:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787758906.426557:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787758906.426666:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787758906.426774:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787758906.427014:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787758906.427469:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787758906.427599:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787758906.427741:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787758906.428003:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787758906.428273:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787758906.428727:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787758906.429271:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787758906.429554:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787758906.429675:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787758906.429797:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787758906.430236:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787758906.430490:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787758906.430622:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787758906.430792:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787758906.431229:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787758906.431379:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787758906.431489:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787758906.431601:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787758906.431719:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787758906.432133:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787758906.432299:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787758906.432439:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787758906.432626:0:5929:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1787758906.432875:0:5986:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787758906.432946:0:5986:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787758906.432950:0:5986:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1787758906.437450:0:5929:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787758906.437491:0:5929:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa87281c6f988 00100000:10000000:0.0:1787758906.437513:0:5929:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787758906.438468:0:5929:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787758906.438485:0:5929:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.133@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787758906.438502:0:5929:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787758906.438518:0:5929:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787758906.439707:0:5929:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787758906.442503:0:5929:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787758906.778694:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758907.802875:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758908.826515:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758909.852417:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758910.878128:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787758911.637189:0:6230:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1787758911.833908:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787758911.833917:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88b2e05c4000 from 3 10000000:01000000:1.0:1787758911.833922:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787758911.834105:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 00000000dd97f93b/0x1a77009127f04f77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758911.834130:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 00000000dd97f93b/0x1a77009127f04f77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758911.834141:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 00000000dd97f93b/0x1a77009127f04f77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758911.834165:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec6762ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995589248:0@lo:101: 00000100:00100000:1.0:1787758911.834240:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758911.834298:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set 00000000907d249b going to sleep for 11 seconds 00000100:00100000:3.0:1787758911.834567:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995589248 00000100:00100000:3.0:1787758911.834575:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995589248 00000100:00100000:3.0:1787758911.834627:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787758911.834636:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000070db8a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:5950:x1874600995589248:12345-0@lo:101: 00010000:00010000:3.0:1787758911.834648:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758911.834661:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071fb0aaf/0x1a77009127f04f7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f04f77 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758911.834683:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071fb0aaf/0x1a77009127f04f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f04f77 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758911.834694:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071fb0aaf/0x1a77009127f04f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04f77 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758911.834711:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071fb0aaf, rc 0) 00000100:00100000:3.0:1787758911.834771:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000070db8a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5950:x1874600995589248:12345-0@lo:101: Request processed in 137us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758911.834778:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787758911.835059:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec6762ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995589248:0@lo:101: 00010000:00010000:0.0:1787758911.835075:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 00000000dd97f93b/0x1a77009127f04f77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f7e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758911.835084:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 00000000dd97f93b/0x1a77009127f04f77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f04f7e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758911.835148:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000029b1e0b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995589376:0@lo:256: 00000100:00100000:0.0:1787758911.835192:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758911.835219:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a029f5b going to sleep for 11 seconds 00000100:00100000:3.0:1787758911.835451:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995589376 00000100:00100000:3.0:1787758911.835457:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995589376 00000100:00100000:3.0:1787758911.835494:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787758911.835501:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050d67efc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5950:x1874600995589376:12345-0@lo:256: 20000000:01000000:3.0:1787758911.835514:0:5946:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787758911.835531:0:5946:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787758911.835534:0:5946:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787758911.835613:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050d67efc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5950:x1874600995589376:12345-0@lo:256: Request processed in 113us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758911.835620:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787758911.835647:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000029b1e0b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995589376:0@lo:256: 10000000:01000000:3.0:1787758911.835683:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787758911.835689:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: 00000000dd97f93b/0x1a77009127f04f77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f7e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758911.835697:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: 00000000dd97f93b/0x1a77009127f04f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f7e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787758911.836708:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787758911.836717:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787758911.836720:0:479:0:(import.c:65:import_set_state_nolock()) 00000000efdd8882 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787758911.836729:0:479:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000efdd8882 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:1.0:1787758911.836757:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000089db7ac5 x1874600995589504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787758911.836937:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000089db7ac5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3440:1874600995589504:0@lo:38: 00000100:00100000:0.0:1787758911.836995:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758911.837092:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995589504 00000100:00100000:1.0:1787758911.837099:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995589504 00000100:00100000:1.0:1787758911.837146:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787758911.837152:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad86d011 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3440:x1874600995589504:12345-0@lo:38: 00010000:00080000:1.0:1787758911.837182:0:5955:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:1.0:1787758911.837216:0:5955:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1a77009127f04f85 00000004:00100000:1.0:1787758911.837255:0:5955:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787758911.837373:0:5955:0:(import.c:65:import_set_state_nolock()) 000000000b4ef646 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787758911.837425:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad86d011 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1874600995589504:12345-0@lo:38: Request processed in 272us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758911.837431:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787758911.837469:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000089db7ac5 x1874600995589504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787758921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787758911.837483:0:3440:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787758911.837489:0:3440:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787758911.837493:0:3440:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787758911.837495:0:3440:0:(import.c:65:import_set_state_nolock()) 00000000efdd8882 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787758911.837500:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000089db7ac5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3440:1874600995589504:0@lo:38: 00010000:00010000:0.0:1787758911.916521:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787758912.919819:0:6283:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787758912.921171:0:6283:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787758912.922729:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758913.946059:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758914.972184:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758915.995612:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787758916.053649:0:6385:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787758916.053921:0:6385:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787758916.958906:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001465f89a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995589632:0@lo:400: 00000100:00100000:0.0:1787758916.958990:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758916.959065:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787758916.959072:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f367b71d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995589760:0@lo:400: 00000100:00100000:0.0:1787758916.959099:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758916.959240:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995589632 00000100:00100000:0.0:1787758916.959247:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995589632 00000100:00100000:0.0:1787758916.959291:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787758916.959300:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e66190b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:3443:x1874600995589632:12345-0@lo:400: 00000100:00100000:0.0:1787758916.959349:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e66190b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:3443:x1874600995589632:12345-0@lo:400: Request processed in 51us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758916.959356:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787758916.959391:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995589760 00000100:00100000:0.0:1787758916.959395:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995589760 00000100:00100000:0.0:1787758916.959419:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787758916.959461:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b801eebc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995589760:12345-0@lo:400: 00000100:00100000:0.0:1787758916.959495:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b801eebc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995589760:12345-0@lo:400: Request processed in 70us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758916.959501:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787758916.959536:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f367b71d x1874600995589760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758916.959551:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f367b71d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995589760:0@lo:400: 00000100:00100000:0.0:1787758916.959561:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001465f89a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995589632:0@lo:400: 00010000:00010000:0.0:1787758917.019681:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787758917.279172:0:6433:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed6f53b10 20000000:00000080:2.0:1787758917.279192:0:6433:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88b30195b000 uarg=0000000000000000 20000000:01000000:2.0:1787758917.279233:0:6433:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787758917.279241:0:6433:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787758917.279246:0:6433:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787758917.279319:0:6433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787758917.279331:0:6433:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787758917.292162:0:6433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787758917.292414:0:6433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787758917.292448:0:6433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787758917.292474:0:6433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787758917.292492:0:6433:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787758917.292510:0:6433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758917.292529:0:6433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000597d7d68/0x1a77009127f04f4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04f46 expref: 11 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758917.292536:0:6433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758917.292571:0:6433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000597d7d68/0x1a77009127f04f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f04f46 expref: 11 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758917.292585:0:6433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000597d7d68/0x1a77009127f04f4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f04f46 expref: 11 pid: 5946 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758917.292597:0:6433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027d22832 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6433:1874600995589888:0@lo:104: 00000100:00100000:3.0:1787758917.292676:0:6433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758917.292733:0:6433:0:(client.c:2715:ptlrpc_set_wait()) set 000000007eb05fb0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758917.292904:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995589888 00000100:00100000:2.0:1787758917.292911:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995589888 00000100:00100000:2.0:1787758917.292957:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787758917.292964:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056bd7e4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:6433:x1874600995589888:12345-0@lo:104: 00010000:00010000:2.0:1787758917.292974:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04f4d expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293042:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787758917.293046:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056bd7e4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:6433:x1874600995589888:12345-0@lo:104: Request processed in 84us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758917.293054:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787758917.293074:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787758917.293079:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04f4d expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293086:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000003974943 already unused, calling callback (000000003ce86fe9) 10000000:00010000:2.0:1787758917.293089:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f04f4d expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293106:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f04f4d expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787758917.293112:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f04f4d expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758917.293118:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787758917.293146:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f4d expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293152:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787758917.293166:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f4d expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293172:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: 0000000003974943/0x1a77009127f04f46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f4d expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293186:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758917.293188:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758917.293189:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758917.293206:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b234994 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995590016:0@lo:103: 00000100:00100000:2.0:1787758917.293232:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758917.293272:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995590016 00000100:00100000:2.0:1787758917.293275:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995590016 00010000:00010000:2.0:1787758917.293306:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000597d7d68/0x1a77009127f04f4d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04f46 expref: 12 pid: 5946 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758917.293327:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787758917.293332:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bb09d90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:3441:x1874600995590016:12345-0@lo:103: 00010000:00010000:2.0:1787758917.293345:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787758917.293349:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000597d7d68/0x1a77009127f04f4d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04f46 expref: 12 pid: 5946 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293357:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000597d7d68/0x1a77009127f04f4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f04f46 expref: 12 pid: 5946 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293372:0:5939:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293378:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293389:0:5939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293395:0:5939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293399:0:5939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293404:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293408:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e58067ac already unused, calling callback (000000003aa1823c) 00010000:00010000:2.0:1787758917.293411:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293416:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293433:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758917.293442:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787758917.293468:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bb09d90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:3441:x1874600995590016:12345-0@lo:103: Request processed in 137us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758917.293475:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787758917.293541:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b234994 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995590016:0@lo:103: 00010000:00010000:3.0:1787758917.294107:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000597d7d68/0x1a77009127f04f4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f04f46 expref: 11 pid: 5946 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758917.294119:0:6433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027d22832 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6433:1874600995589888:0@lo:104: 00010000:00010000:3.0:1787758917.294132:0:6433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758917.294140:0:6433:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758917.294144:0:6433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758917.294157:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e58067ac/0x1a77009127f04f8c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758918.042179:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758919.070634:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787758919.194411:0:5950:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787758919.194420:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b2e05c4000 from 1 10000000:01000000:2.0:1787758919.194425:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787758919.194471:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: 0000000022b2716a/0x1a77009127f04f93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758919.194482:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: 0000000022b2716a/0x1a77009127f04f93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758919.194493:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: 0000000022b2716a/0x1a77009127f04f93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758919.194531:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b234994 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995590144:0@lo:101: 00000100:00100000:2.0:1787758919.194598:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758919.194641:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b49789cb going to sleep for 11 seconds 00000100:00100000:0.0:1787758919.194743:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995590144 00000100:00100000:0.0:1787758919.194751:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995590144 00000100:00100000:0.0:1787758919.194820:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787758919.194829:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fcfe1afe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:5950:x1874600995590144:12345-0@lo:101: 00010000:00010000:0.0:1787758919.194886:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758919.194898:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005349851b/0x1a77009127f04f9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f04f93 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758919.194921:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005349851b/0x1a77009127f04f9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f04f93 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758919.194931:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005349851b/0x1a77009127f04f9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04f93 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758919.194939:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005349851b, rc 0) 00000100:00100000:0.0:1787758919.194985:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fcfe1afe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5950:x1874600995590144:12345-0@lo:101: Request processed in 157us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758919.194992:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787758919.195190:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b234994 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995590144:0@lo:101: 00010000:00010000:2.0:1787758919.195201:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: 0000000022b2716a/0x1a77009127f04f93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f9a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758919.195218:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: 0000000022b2716a/0x1a77009127f04f93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f04f9a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758919.195269:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b234994 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995590272:0@lo:501: 00000100:00100000:2.0:1787758919.195292:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758919.195319:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b49789cb going to sleep for 11 seconds 00000100:00100000:0.0:1787758919.195362:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995590272 00000100:00100000:0.0:1787758919.195366:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995590272 00000100:00100000:0.0:1787758919.195395:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787758919.195400:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e7066c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5950:x1874600995590272:12345-0@lo:501: 00000100:00100000:0.0:1787758919.195509:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e7066c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5950:x1874600995590272:12345-0@lo:501: Request processed in 109us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758919.195516:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787758919.195570:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b234994 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995590272:0@lo:501: 00000100:00100000:3.0:1787758919.195595:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9f8ae30 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995590400:0@lo:503: 00000100:00100000:3.0:1787758919.195629:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758919.195648:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ffe75ae0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758919.195730:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995590400 00000100:00100000:0.0:1787758919.195734:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995590400 00000100:00100000:0.0:1787758919.195761:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787758919.195774:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086aed508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5950:x1874600995590400:12345-0@lo:503: 00000100:00100000:0.0:1787758919.195864:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086aed508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5950:x1874600995590400:12345-0@lo:503: Request processed in 98us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758919.195870:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787758919.196006:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9f8ae30 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995590400:0@lo:503: 00000100:00100000:3.0:1787758919.196569:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9f8ae30 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6502:1874600995590528:0@lo:502: 00000100:00100000:3.0:1787758919.196607:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758919.196635:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 000000003738e18e going to sleep for 11 seconds 00000100:00100000:0.0:1787758919.196732:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995590528 00000100:00100000:0.0:1787758919.196736:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995590528 00000100:00100000:0.0:1787758919.196771:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787758919.196776:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049d15abf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6502:x1874600995590528:12345-0@lo:502: 00000100:00100000:0.0:1787758919.196879:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049d15abf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6502:x1874600995590528:12345-0@lo:502: Request processed in 103us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758919.196886:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787758919.196964:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9f8ae30 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6502:1874600995590528:0@lo:502: 00000020:01000000:3.0:1787758919.196995:0:6502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787758919.197005:0:6502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787758919.197007:0:6502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787758919.197014:0:6502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b2e05c4000 00000020:00000080:3.0:1787758919.197016:0:6502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787758919.197055:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6502:1874600995590656:0@lo:502: 00000100:00100000:3.0:1787758919.197088:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758919.197112:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2d5f1a900 going to sleep for 11 seconds 00000100:00100000:0.0:1787758919.197151:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995590656 00000100:00100000:0.0:1787758919.197154:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995590656 00000100:00100000:0.0:1787758919.197184:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787758919.197191:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6502:x1874600995590656:12345-0@lo:502: 00000100:00100000:0.0:1787758919.197250:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6502:x1874600995590656:12345-0@lo:502: Request processed in 59us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758919.197257:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787758919.197329:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6502:1874600995590656:0@lo:502: 00000020:01000000:3.0:1787758919.197347:0:6502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787758919.197351:0:6502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787758919.197352:0:6502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787758919.197355:0:6502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787758919.198143:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787758919.198168:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787758919.198177:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151e400/0x1a77009127f04f93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f9a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758919.198190:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2c151e400/0x1a77009127f04f93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04f9a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758920.101210:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758921.114598:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758922.074092:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995590912:0@lo:400: 00000100:00100000:0.0:1787758922.074174:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758922.074326:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995590912 00000100:00100000:1.0:1787758922.074334:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995590912 00000100:00100000:1.0:1787758922.074397:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787758922.074406:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995590912:12345-0@lo:400: 00000100:00100000:1.0:1787758922.074463:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995590912:12345-0@lo:400: Request processed in 58us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758922.074470:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787758922.074674:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88b2e4aa92c0 x1874600995590912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758922.074688:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995590912:0@lo:400: 00000100:00100000:2.0:1787758922.074793:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995590784:0@lo:400: 00000100:00100000:2.0:1787758922.074828:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758922.074956:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995590784 00000100:00100000:0.0:1787758922.074961:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995590784 00000100:00100000:0.0:1787758922.075002:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787758922.075009:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:3442:x1874600995590784:12345-0@lo:400: 00000100:00100000:0.0:1787758922.075053:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:3442:x1874600995590784:12345-0@lo:400: Request processed in 44us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758922.075060:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787758922.075155:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995590784:0@lo:400: 00010000:00010000:1.0:1787758922.138207:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758923.163019:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758924.187003:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758925.225199:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758926.235760:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758927.194222:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995591168:0@lo:400: 00000100:00100000:1.0:1787758927.194367:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758927.194556:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995591040:0@lo:400: 00000100:00100000:0.0:1787758927.194717:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758927.194759:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995591040 00000100:00100000:0.0:1787758927.194768:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995591040 00000100:00100000:0.0:1787758927.194827:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787758927.194837:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:3444:x1874600995591040:12345-0@lo:400: 00000100:00100000:1.0:1787758927.194973:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995591168 00000100:00100000:1.0:1787758927.194978:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995591168 00000100:00100000:1.0:1787758927.195010:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787758927.195017:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995591168:12345-0@lo:400: 00000100:00100000:1.0:1787758927.195066:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995591168:12345-0@lo:400: Request processed in 49us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758927.195074:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787758927.195113:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88b2e4aaad00 x1874600995591168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758927.195127:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995591168:0@lo:400: 00000100:00100000:1.0:1787758927.195537:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:3444:x1874600995591040:12345-0@lo:400: Request processed in 700us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758927.195545:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787758927.200427:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995591040:0@lo:400: 00010000:00010000:3.0:1787758927.260641:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758928.282986:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787758928.408406:0:6933:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787758928.409107:0:6933:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787758928.409110:0:6933:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787758928.409246:0:6933:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88b301aae000 00000020:01000004:0.0:1787758928.409262:0:6933:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787758928.409274:0:6933:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787758928.409288:0:6933:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff88b300e38000) 00000020:00000080:0.0:1787758928.409304:0:6933:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787758928.487828:0:6933:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787758928.487940:0:6933:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1787758928.552455:0:6933:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787758928.552739:0:6933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787758928.552751:0:6933:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787758928.552765:0:6933:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1a77009127f04fa8 00000020:01000004:1.0:1787758928.552774:0:6933:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787758928.552814:0:6933:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.133@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787758928.552819:0:6933:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787758928.552827:0:6933:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787758928.552833:0:6933:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787758928.553055:0:6933:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff88b2f547b490) 00000020:00000080:1.0:1787758928.553070:0:6933:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1787758928.557611:0:6933:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787758928.557892:0:6933:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787758928.557900:0:6933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787758928.566553:0:6933:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787758928.566575:0:6933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787758928.567144:0:6933:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787758928.567151:0:6933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787758928.568786:0:6933:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787758928.569087:0:6933:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787758928.569093:0:6933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787758928.572520:0:6933:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787758928.572535:0:6933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787758928.613398:0:6933:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787758928.613740:0:6933:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787758928.613749:0:6933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787758928.616649:0:6933:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787758928.616671:0:6933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787758928.618800:0:6933:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787758928.618819:0:6933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787758928.625619:0:6933:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787758928.626226:0:6933:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787758928.626234:0:6933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787758928.627477:0:6933:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787758928.627490:0:6933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787758928.691716:0:6933:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787758928.695549:0:6933:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787758928.695574:0:6933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787758928.702011:0:6933:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787758928.702034:0:6933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787758928.702774:0:6933:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787758928.702820:0:6933:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787758928.702828:0:6933:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.133@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787758928.739941:0:6933:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.133@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787758928.740107:0:6933:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.133@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787758928.740111:0:6933:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787758928.740113:0:6933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787758928.740114:0:6933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758928.740116:0:6933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787758928.740116:0:6933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758928.740118:0:6933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758928.740119:0:6933:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787758928.740121:0:6933:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787758928.740122:0:6933:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787758928.740124:0:6933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758928.740125:0:6933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787758928.740128:0:6933:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787758928.740131:0:6933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787758928.740132:0:6933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787758928.740133:0:6933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758928.740134:0:6933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787758928.740135:0:6933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758928.740136:0:6933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758928.740137:0:6933:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787758928.740138:0:6933:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787758928.740139:0:6933:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787758928.740140:0:6933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758928.740141:0:6933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787758928.740169:0:6933:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787758928.740188:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36da580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995591296:0@lo:253: 00000100:00100000:0.0:1787758928.740340:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.740453:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995591296 00000100:00100000:0.0:1787758928.740465:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c77bf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758928.740471:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995591296 00000100:00100000:1.0:1787758928.740571:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787758928.740583:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6933:x1874600995591296:12345-0@lo:253: 20000000:01000000:1.0:1787758928.740653:0:5946:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787758928.740658:0:5946:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787758928.740665:0:5946:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787758928.740670:0:5946:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787758928.741093:0:5946:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787758928.745189:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787758928.745234:0:5946:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787758928.745278:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787758928.745285:0:5946:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787758928.745300:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787758928.745317:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787758928.745473:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787758928.745495:0:5946:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.133@tcp 20000000:01000000:1.0:1787758928.745497:0:5946:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.133@tcp (null) (null) (null) 00000040:00080000:1.0:1787758928.745511:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787758928.745517:0:5946:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787758928.745531:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787758928.745538:0:5946:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.133@tcp (null) (null) 00000040:00080000:1.0:1787758928.745551:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787758928.745559:0:5946:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787758928.745572:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787758928.745588:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787758928.746009:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787758928.746023:0:5946:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.133@tcp 20000000:01000000:1.0:1787758928.746035:0:5946:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.133@tcp (null) (null) (null) 00000040:00080000:1.0:1787758928.746054:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787758928.746062:0:5946:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787758928.746075:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787758928.746080:0:5946:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.133@tcp (null) (null) 00000040:00080000:1.0:1787758928.746116:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787758928.746124:0:5946:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787758928.746139:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787758928.746153:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787758928.746169:0:5946:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787758928.746172:0:5946:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787758928.746177:0:5946:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787758928.746238:0:5946:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787758928.746241:0:5946:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787758928.751237:0:6952:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787758928.752621:0:6952:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787758928.752667:0:6952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787758928.753516:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787758928.753544:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787758928.753558:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787758928.753570:0:5946:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787758928.753573:0:5946:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787758928.771173:0:6953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787758928.771556:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787758928.771585:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787758928.771597:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787758928.771606:0:5946:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787758928.771609:0:5946:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787758928.779813:0:6954:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787758928.780614:0:6954:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787758928.780661:0:6954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787758928.781061:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787758928.781090:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787758928.781115:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:2.0:1787758928.781133:0:5946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787758928.781156:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.781177:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2c13f7000/0x1a77009127f04ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04ec8 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.781186:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2c13f6600/0x1a77009127f04eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04ee4 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.781195:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2e350de00/0x1a77009127f04f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04f54 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.781211:0:5946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.781275:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2e350de00/0x1a77009127f04f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f04f54 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.781291:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2e350de00/0x1a77009127f04f5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f04f54 expref: 12 pid: 5946 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.781308:0:5946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36eda40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5946:1874600995591424:0@lo:104: 00000100:00100000:2.0:1787758928.781397:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787758928.781494:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2c13f6600/0x1a77009127f04eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f04ee4 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.781502:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2c13f6600/0x1a77009127f04eeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f04ee4 expref: 12 pid: 5947 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.781509:0:5946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5946:1874600995591552:0@lo:104: 00000100:00100000:2.0:1787758928.781530:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787758928.781566:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2c13f7000/0x1a77009127f04ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f04ec8 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.781574:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2c13f7000/0x1a77009127f04ecf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f04ec8 expref: 12 pid: 5947 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.781583:0:5946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ed680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5946:1874600995591680:0@lo:104: 00000100:00100000:2.0:1787758928.781601:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758928.781610:0:5946:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2d5d8c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.782099:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995591424 00000100:00100000:2.0:1787758928.782120:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995591424 00000100:00100000:2.0:1787758928.782169:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995591552 00000100:00100000:2.0:1787758928.782172:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995591552 00000100:00100000:2.0:1787758928.782183:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995591680 00000100:00100000:2.0:1787758928.782185:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995591680 00000100:00100000:2.0:1787758928.782200:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787758928.782208:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+5:5946:x1874600995591424:12345-0@lo:104: 00010000:00010000:2.0:1787758928.782223:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2c151fe00/0x1a77009127f04f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04f5b expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.782523:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787758928.782531:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+5:5946:x1874600995591424:12345-0@lo:104: Request processed in 323us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.782539:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787758928.782562:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787758928.782569:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36ec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+4:5946:x1874600995591552:12345-0@lo:104: 00010000:00010000:2.0:1787758928.782576:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2c151f800/0x1a77009127f04ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04eeb expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.782611:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787758928.782616:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36ec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+4:5946:x1874600995591552:12345-0@lo:104: Request processed in 49us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.782622:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787758928.782634:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787758928.782640:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:5946:x1874600995591680:12345-0@lo:104: 00010000:00010000:2.0:1787758928.782647:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f04ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04ecf expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.782672:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787758928.782684:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:5946:x1874600995591680:12345-0@lo:104: Request processed in 44us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.782690:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787758928.782735:0:5946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36eda40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5946:1874600995591424:0@lo:104: 00000100:00100000:2.0:1787758928.782744:0:5946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5946:1874600995591552:0@lo:104: 00000100:00100000:2.0:1787758928.782750:0:5946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ed680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5946:1874600995591680:0@lo:104: 00010000:00010000:2.0:1787758928.782779:0:5946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.783084:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787758928.783094:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c151fe00/0x1a77009127f04f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04f5b expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.783103:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c151fe00 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:1.0:1787758928.783115:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151fe00/0x1a77009127f04f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f04f5b expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.783126:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c151fe00/0x1a77009127f04f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f04f5b expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787758928.783134:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151fe00/0x1a77009127f04f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f04f5b expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758928.783141:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787758928.783184:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c151fe00/0x1a77009127f04f54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f5b expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.783190:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787758928.783213:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c151fe00/0x1a77009127f04f54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f5b expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.783221:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c151fe00/0x1a77009127f04f54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f5b expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.783232:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787758928.783236:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c151f800/0x1a77009127f04ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04eeb expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.783349:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787758928.783590:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758928.783599:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f04ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04ecf expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.783606:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2e472a800 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:3.0:1787758928.783609:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f04ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f04ecf expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.783616:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f04ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f04ecf expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787758928.783622:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f04ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f04ecf expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758928.783627:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787758928.783644:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f04ec8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04ecf expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.783649:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787758928.783665:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f04ec8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04ecf expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.783672:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f04ec8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04ecf expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.783685:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758928.783692:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758928.783694:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758928.783711:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995591936:0@lo:103: 00000100:00100000:3.0:1787758928.783768:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787758928.783982:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c151f800 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:1.0:1787758928.783987:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151f800/0x1a77009127f04ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f04eeb expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.783995:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c151f800/0x1a77009127f04ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f04eeb expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787758928.784013:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151f800/0x1a77009127f04ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f04eeb expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758928.784019:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787758928.784036:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c151f800/0x1a77009127f04ee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04eeb expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.784042:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787758928.784146:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995591808:0@lo:103: 00000100:00100000:2.0:1787758928.784176:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758928.784215:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995591936 00000100:00100000:2.0:1787758928.784222:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995591936 00010000:00010000:2.0:1787758928.784266:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2c13f7000/0x1a77009127f04ecf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04ec8 expref: 13 pid: 5947 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.784350:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995592064:0@lo:103: 00000100:00100000:0.0:1787758928.784381:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787758928.787165:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c151f800/0x1a77009127f04ee4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04eeb expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.787188:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c151f800/0x1a77009127f04ee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04eeb expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.787221:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758928.787224:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758928.787227:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758928.792460:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995591808 00000100:00100000:2.0:1787758928.792477:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995591808 00000100:00100000:3.0:1787758928.794071:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995592064 00000100:00100000:3.0:1787758928.794088:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995592064 00010000:00010000:3.0:1787758928.794150:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2c13f6600/0x1a77009127f04eeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04ee4 expref: 15 pid: 5947 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758928.794188:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787758928.794199:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:3443:x1874600995591936:12345-0@lo:103: 00010000:00010000:3.0:1787758928.794219:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787758928.794225:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2c13f7000/0x1a77009127f04ecf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04ec8 expref: 15 pid: 5947 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.794236:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2c13f7000/0x1a77009127f04ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f04ec8 expref: 15 pid: 5947 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.794388:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c13f7000/0x1a77009127f04ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f04ec8 expref: 15 pid: 5947 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.794411:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787758928.794521:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:3443:x1874600995591936:12345-0@lo:103: Request processed in 324us (10752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.794531:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787758928.794555:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787758928.794562:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36d9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:3444:x1874600995592064:12345-0@lo:103: 00010000:00010000:3.0:1787758928.794570:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787758928.794575:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2c13f6600/0x1a77009127f04eeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04ee4 expref: 13 pid: 5947 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.794602:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2c13f6600/0x1a77009127f04eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f04ee4 expref: 13 pid: 5947 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.794612:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c13f6600/0x1a77009127f04eeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f04ee4 expref: 13 pid: 5947 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.794624:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787758928.794671:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36d9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:3444:x1874600995592064:12345-0@lo:103: Request processed in 110us (10289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.794678:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787758928.794731:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995592064:0@lo:103: 00010000:00010000:3.0:1787758928.794780:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758928.795091:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995591936:0@lo:103: 00010000:00010000:3.0:1787758928.795336:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758928.799667:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2e350de00/0x1a77009127f04f5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04f54 expref: 11 pid: 5946 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.799769:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787758928.799794:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:3442:x1874600995591808:12345-0@lo:103: 00010000:00010000:2.0:1787758928.799815:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787758928.799822:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2e350de00/0x1a77009127f04f5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04f54 expref: 11 pid: 5946 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.799876:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2e350de00/0x1a77009127f04f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f04f54 expref: 11 pid: 5946 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.799916:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2e350de00/0x1a77009127f04f5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f04f54 expref: 11 pid: 5946 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.799939:0:5938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.799948:0:5938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.799968:0:5938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.799976:0:5938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.799982:0:5938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.799990:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.799997:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c151f000 already unused, calling callback (ffffffffc0e68530) 00010000:00010000:2.0:1787758928.800002:0:5938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.800011:0:5938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.800031:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.802398:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787758928.802544:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+10:3442:x1874600995591808:12345-0@lo:103: Request processed in 2758us (18360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.802561:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787758928.802736:0:5946:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.802749:0:5946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.802757:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c151f000/0x1a77009127f04fb6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787758928.802774:0:5946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787758928.803467:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995591808:0@lo:103: 00000100:00100000:0.0:1787758928.807309:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+9:6933:x1874600995591296:12345-0@lo:253: Request processed in 66713us (66954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758928.807344:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787758928.807643:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36da580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995591296:0@lo:253: 10000000:01000000:1.0:1787758928.807670:0:6933:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787758928.807673:0:6933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787758928.807675:0:6933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787758928.807677:0:6933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787758928.807678:0:6933:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787758928.807680:0:6933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787758928.807681:0:6933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787758928.807683:0:6933:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787758928.807684:0:6933:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787758928.807686:0:6933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787758928.807687:0:6933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787758928.807713:0:6933:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88b301aae000 from lustre-OST0000 10000000:01000000:1.0:1787758928.807747:0:6933:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787758928.807750:0:6933:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787758928.807758:0:6933:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88b300e3ced8 local copy 10000000:01000000:1.0:1787758928.807763:0:6933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787758928.807823:0:6933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.807836:0:6933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.807885:0:6933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.807910:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995592192:0@lo:101: 00000100:00100000:1.0:1787758928.807957:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.808016:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787758928.808189:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995592192 00000100:00100000:0.0:1787758928.808197:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995592192 00000100:00100000:0.0:1787758928.808260:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787758928.808271:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+9:6933:x1874600995592192:12345-0@lo:101: 00010000:00010000:0.0:1787758928.808287:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758928.808304:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e472b400/0x1a77009127f04fc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f04fbd expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.808333:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e472b400/0x1a77009127f04fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f04fbd expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.808344:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e472b400/0x1a77009127f04fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04fbd expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.808355:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e472b400, rc 0) 00000100:00100000:0.0:1787758928.808394:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+10:6933:x1874600995592192:12345-0@lo:101: Request processed in 125us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758928.808413:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787758928.808592:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995592192:0@lo:101: 00010000:00010000:1.0:1787758928.808608:0:6933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1a77009127f04fc4 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.808633:0:6933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1a77009127f04fc4 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.808743:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995592320:0@lo:501: 00000100:00100000:1.0:1787758928.808770:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.808802:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787758928.809158:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995592320 00000100:00100000:0.0:1787758928.809164:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995592320 00000100:00100000:0.0:1787758928.809200:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787758928.809208:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+10:6933:x1874600995592320:12345-0@lo:501: 00000100:00100000:0.0:1787758928.809373:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+10:6933:x1874600995592320:12345-0@lo:501: Request processed in 165us (601us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787758928.809381:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787758928.809487:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995592320:0@lo:501: 10000000:01000000:1.0:1787758928.809501:0:6933:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787758928.809522:0:6933:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787758928.809527:0:6933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1a77009127f04fc4 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.809535:0:6933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1a77009127f04fc4 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.809541:0:6933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1a77009127f04fc4 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.809564:0:6933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787758928.809589:0:6933:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88b301aae000 10000000:01000000:1.0:1787758928.809594:0:6933:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787758928.809599:0:6933:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff88b300e3ced8 10000000:01000000:1.0:1787758928.809601:0:6933:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787758928.809605:0:6933:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff88b300e3ced8 from 1 10000000:01000000:1.0:1787758928.809607:0:6933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787758928.809628:0:6933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6000/0x1a77009127f04fcb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.809649:0:6933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6000/0x1a77009127f04fcb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.809659:0:6933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6000/0x1a77009127f04fcb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.809673:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995592448:0@lo:101: 00000100:00100000:1.0:1787758928.809700:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.809718:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787758928.809735:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995592448 00000100:00100000:1.0:1787758928.809740:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995592448 00000100:00100000:1.0:1787758928.809766:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787758928.809774:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+10:6933:x1874600995592448:12345-0@lo:101: 00010000:00010000:1.0:1787758928.809794:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758928.809807:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c13f6e00/0x1a77009127f04fd2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f04fcb expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.809825:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c13f6e00/0x1a77009127f04fd2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f04fcb expref: 11 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.809835:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c13f6e00/0x1a77009127f04fd2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04fcb expref: 11 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.810323:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c13f6e00, rc 0) 00000100:00100000:1.0:1787758928.810363:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:6933:x1874600995592448:12345-0@lo:101: Request processed in 590us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.810370:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1787758928.810566:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787758928.810575:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1a77009127f04fc4 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.810584:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c13f7800 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:3.0:1787758928.810588:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1a77009127f04fc4 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.810598:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x1a77009127f04fc4 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787758928.810605:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x1a77009127f04fc4 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758928.810612:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787758928.810639:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1a77009127f04fc4 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.810655:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787758928.810686:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1a77009127f04fc4 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.810695:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7800/0x1a77009127f04fbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1a77009127f04fc4 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.810712:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758928.810714:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758928.810716:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758928.811009:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995592448:0@lo:101: 00010000:00010000:1.0:1787758928.811031:0:6933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6000/0x1a77009127f04fcb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04fd2 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.811041:0:6933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6000/0x1a77009127f04fcb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f04fd2 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.811139:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995592576:0@lo:103: 00000100:00100000:0.0:1787758928.811197:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758928.811359:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995592576 00000100:00100000:3.0:1787758928.811365:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995592576 00000100:00100000:3.0:1787758928.811595:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787758928.811606:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:3441:x1874600995592576:12345-0@lo:103: 00010000:00010000:3.0:1787758928.811620:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787758928.811637:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2e472b400/0x1a77009127f04fc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a77009127f04fbd expref: 11 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.811652:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787758928.811685:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+10:3441:x1874600995592576:12345-0@lo:103: Request processed in 82us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.811693:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 10000000:01000000:1.0:1787758928.811965:0:6933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787758928.811980:0:6933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6000/0x1a77009127f04fcb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04fd2 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.811990:0:6933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6000/0x1a77009127f04fcb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04fd2 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758928.812001:0:6933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787758928.812009:0:6933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787758928.812018:0:6933:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787758928.812020:0:6933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000100:00100000:0.0:1787758928.812159:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995592576:0@lo:103: 00010000:00010000:1.0:1787758928.812469:0:6933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.812479:0:6933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.812490:0:6933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.812512:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995592704:0@lo:101: 00000100:00100000:1.0:1787758928.812555:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.812616:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787758928.819155:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995592704 00000100:00100000:0.0:1787758928.819175:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995592704 00000100:00100000:2.0:1787758928.819664:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787758928.819677:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+10:6933:x1874600995592704:12345-0@lo:101: 00010000:00010000:2.0:1787758928.819699:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758928.819724:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c151f800/0x1a77009127f04fe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f04fd9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.819757:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c151f800/0x1a77009127f04fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f04fd9 expref: 11 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.819770:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c151f800/0x1a77009127f04fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04fd9 expref: 11 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.819780:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c151f800, rc 0) 00000100:00100000:2.0:1787758928.819924:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:6933:x1874600995592704:12345-0@lo:101: Request processed in 250us (7369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.819931:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787758928.820055:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995592704:0@lo:101: 00010000:00010000:3.0:1787758928.820079:0:6933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04fe0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.820090:0:6933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f04fe0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758928.820257:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995592832:0@lo:501: 00000100:00100000:3.0:1787758928.820296:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758928.820735:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b30196ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787758928.820805:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995592832 00000100:00100000:1.0:1787758928.820821:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995592832 00000100:00100000:1.0:1787758928.821010:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787758928.821019:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:6933:x1874600995592832:12345-0@lo:501: 00000100:00100000:1.0:1787758928.821300:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:6933:x1874600995592832:12345-0@lo:501: Request processed in 282us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.821311:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787758928.821629:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995592832:0@lo:501: 00000100:00100000:3.0:1787758928.821675:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995592960:0@lo:503: 00000100:00100000:3.0:1787758928.821725:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758928.821805:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b30196ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787758928.821959:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995592960 00000100:00100000:0.0:1787758928.821967:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995592960 00000100:00100000:1.0:1787758928.822097:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787758928.822107:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:6933:x1874600995592960:12345-0@lo:503: 00000100:00100000:1.0:1787758928.822313:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:6933:x1874600995592960:12345-0@lo:503: Request processed in 207us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.822320:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787758928.822525:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995592960:0@lo:503: 00000040:00080000:3.0:1787758928.822958:0:6933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787758928.823055:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593088:0@lo:502: 00000100:00100000:3.0:1787758928.823107:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758928.823551:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b30196ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787758928.823642:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995593088 00000100:00100000:1.0:1787758928.823649:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995593088 00000100:00100000:1.0:1787758928.823687:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787758928.823695:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:6933:x1874600995593088:12345-0@lo:502: 00000100:00100000:1.0:1787758928.823825:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:6933:x1874600995593088:12345-0@lo:502: Request processed in 130us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.823833:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787758928.824038:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593088:0@lo:502: 00000040:00080000:3.0:1787758928.824349:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787758928.824380:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787758928.824396:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787758928.824685:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787758928.824701:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787758928.824712:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787758928.824748:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593216:0@lo:502: 00000100:00100000:3.0:1787758928.824817:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758928.824886:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b30196ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.825010:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995593216 00000100:00100000:2.0:1787758928.825017:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995593216 00000100:00100000:2.0:1787758928.825069:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787758928.825078:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:6933:x1874600995593216:12345-0@lo:502: 00000100:00100000:2.0:1787758928.825193:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:6933:x1874600995593216:12345-0@lo:502: Request processed in 115us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.825202:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787758928.825540:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593216:0@lo:502: 00000040:00080000:3.0:1787758928.825591:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787758928.825608:0:6933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787758928.826365:0:6956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787758928.826376:0:6956:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787758928.826386:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787758928.826389:0:6956:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787758928.826395:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787758928.826499:0:6956:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff88b2fe273490) 00000020:00000080:3.0:1787758928.826530:0:6956:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787758928.826539:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787758928.826686:0:6956:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b301aae000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787758928.826695:0:6956:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787758928.826705:0:6956:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1a77009127f04fee 00010000:00010000:2.0:1787758928.837738:0:6956:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787758928.838552:0:6956:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787758928.842229:0:6956:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787758928.842992:0:6956:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787758928.853511:0:6956:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1787758928.853701:0:6956:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787758928.865503:0:6956:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1787758928.878454:0:6956:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787758928.878475:0:6956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787758928.878486:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758928.878489:0:6956:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787758928.878493:0:6956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787758928.878498:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758928.878500:0:6956:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787758928.878503:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787758928.878505:0:6956:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787758928.878540:0:6956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787758928.878543:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758928.878545:0:6956:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787758928.878548:0:6956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787758928.878820:0:6933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787758928.878876:0:6933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787758928.878900:0:6933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04fe0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.878916:0:6933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04fe0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758928.878927:0:6933:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b301aae000 from 1 10000000:01000000:3.0:1787758928.878931:0:6933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787758928.878994:0:6933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.879003:0:6933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.879019:0:6933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758928.879055:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593344:0@lo:101: 00000100:00100000:3.0:1787758928.879178:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758928.879244:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b30196e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.881976:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995593344 00000100:00100000:2.0:1787758928.882000:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995593344 00000100:00100000:2.0:1787758928.882090:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787758928.882103:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:6933:x1874600995593344:12345-0@lo:101: 00010000:00010000:2.0:1787758928.882128:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758928.882154:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c151fe00/0x1a77009127f04ffc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f04ff5 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.882195:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c151fe00/0x1a77009127f04ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f04ff5 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.882209:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c151fe00/0x1a77009127f04ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04ff5 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.882239:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c151fe00, rc 0) 00000100:00100000:2.0:1787758928.882346:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6933:x1874600995593344:12345-0@lo:101: Request processed in 246us (3170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.882354:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787758928.885972:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593344:0@lo:101: 00010000:00010000:0.0:1787758928.886016:0:6933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04ffc expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.886032:0:6933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f04ffc expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.886208:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593472:0@lo:501: 00000100:00100000:0.0:1787758928.886294:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758928.886343:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2f53c8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787758928.886371:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995593472 00000100:00100000:0.0:1787758928.886377:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995593472 00000100:00100000:0.0:1787758928.886432:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787758928.886442:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6933:x1874600995593472:12345-0@lo:501: 00000100:00100000:0.0:1787758928.886597:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6933:x1874600995593472:12345-0@lo:501: Request processed in 155us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758928.886605:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787758928.886659:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593472:0@lo:501: 00000100:00100000:0.0:1787758928.886690:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593600:0@lo:503: 00000100:00100000:0.0:1787758928.886726:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758928.886751:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2f53c8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787758928.886768:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995593600 00000100:00100000:0.0:1787758928.886772:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995593600 00000100:00100000:0.0:1787758928.886807:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787758928.886814:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6933:x1874600995593600:12345-0@lo:503: 00000100:00100000:0.0:1787758928.886961:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6933:x1874600995593600:12345-0@lo:503: Request processed in 147us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758928.886968:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787758928.887012:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593600:0@lo:503: 00000040:00080000:0.0:1787758928.887323:0:6933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787758928.887411:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593728:0@lo:502: 00000100:00100000:0.0:1787758928.887451:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758928.887478:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2f53c8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787758928.887495:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995593728 00000100:00100000:0.0:1787758928.887500:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995593728 00000100:00100000:0.0:1787758928.887530:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787758928.887537:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6933:x1874600995593728:12345-0@lo:502: 00000100:00100000:0.0:1787758928.887626:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6933:x1874600995593728:12345-0@lo:502: Request processed in 89us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758928.887633:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787758928.887678:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593728:0@lo:502: 00000040:00080000:0.0:1787758928.887943:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787758928.887970:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787758928.887991:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593856:0@lo:502: 00000100:00100000:0.0:1787758928.888026:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758928.888045:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2f53c8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787758928.888059:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995593856 00000100:00100000:0.0:1787758928.888069:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995593856 00000100:00100000:0.0:1787758928.888093:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787758928.888099:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6933:x1874600995593856:12345-0@lo:502: 00000100:00100000:0.0:1787758928.888157:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6933:x1874600995593856:12345-0@lo:502: Request processed in 57us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758928.888163:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787758928.888202:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593856:0@lo:502: 00000040:00080000:0.0:1787758928.888236:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787758928.888243:0:6933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787758928.894597:0:6960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787758928.894618:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758928.894621:0:6960:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787758928.894632:0:6960:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b301aae000 00000020:00000080:0.0:1787758928.894635:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787758928.894650:0:6960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758928.894652:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758928.894654:0:6960:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787758928.894657:0:6960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787758928.899983:0:6933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787758928.900062:0:6933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787758928.900090:0:6933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04ffc expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.900106:0:6933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f04ffc expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758928.900190:0:6933:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787758928.900193:0:6933:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88b301aae000 10000000:01000000:2.0:1787758928.900197:0:6933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88b301aae000 10000000:01000000:2.0:1787758928.900201:0:6933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787758928.900210:0:6933:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b301aae000 from 1 10000000:01000000:2.0:1787758928.900213:0:6933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787758928.900269:0:6933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.900278:0:6933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.900291:0:6933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.900323:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593984:0@lo:101: 00000100:00100000:2.0:1787758928.900434:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758928.900509:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0091240 going to sleep for 11 seconds 00000100:00100000:1.0:1787758928.900652:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995593984 00000100:00100000:1.0:1787758928.900660:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995593984 00000100:00100000:1.0:1787758928.900726:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787758928.900738:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:6933:x1874600995593984:12345-0@lo:101: 00010000:00010000:1.0:1787758928.900757:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758928.900774:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c13f7e00/0x1a77009127f0500a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f05003 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.900827:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c13f7e00/0x1a77009127f0500a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f05003 expref: 13 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.900865:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c13f7e00/0x1a77009127f0500a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05003 expref: 13 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.900877:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c13f7e00, rc 0) 00000100:00100000:1.0:1787758928.900929:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6933:x1874600995593984:12345-0@lo:101: Request processed in 194us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.900937:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787758928.902230:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995593984:0@lo:101: 00010000:00010000:2.0:1787758928.902260:0:6933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0500a expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.902273:0:6933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f0500a expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.902421:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995594112:0@lo:501: 00000100:00100000:2.0:1787758928.902478:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758928.902524:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0091240 going to sleep for 11 seconds 00000100:00100000:1.0:1787758928.902593:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995594112 00000100:00100000:1.0:1787758928.902600:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995594112 00000100:00100000:1.0:1787758928.902659:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787758928.902669:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6933:x1874600995594112:12345-0@lo:501: 00000100:00100000:1.0:1787758928.902825:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6933:x1874600995594112:12345-0@lo:501: Request processed in 157us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.902832:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787758928.902965:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995594112:0@lo:501: 00000100:00100000:2.0:1787758928.902998:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995594240:0@lo:503: 00000100:00100000:2.0:1787758928.903066:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758928.903083:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0091240 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.903099:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995594240 00000100:00100000:2.0:1787758928.903103:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995594240 00000100:00100000:2.0:1787758928.903136:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787758928.903142:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6933:x1874600995594240:12345-0@lo:503: 00000100:00100000:2.0:1787758928.903229:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6933:x1874600995594240:12345-0@lo:503: Request processed in 86us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.903236:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787758928.903283:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995594240:0@lo:503: 00000040:00080000:2.0:1787758928.903589:0:6933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787758928.903661:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995594368:0@lo:502: 00000100:00100000:2.0:1787758928.903705:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758928.903722:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0091240 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.903737:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995594368 00000100:00100000:2.0:1787758928.903740:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995594368 00000100:00100000:2.0:1787758928.903778:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787758928.903797:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6933:x1874600995594368:12345-0@lo:502: 00000100:00100000:2.0:1787758928.903924:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6933:x1874600995594368:12345-0@lo:502: Request processed in 127us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.903931:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787758928.903973:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995594368:0@lo:502: 00000040:00080000:2.0:1787758928.904195:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787758928.904225:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787758928.904240:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787758928.904256:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787758928.904270:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787758928.904282:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787758928.904293:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787758928.904306:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787758928.904321:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787758928.904334:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787758928.904347:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787758928.904360:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787758928.904374:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787758928.904387:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787758928.904401:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787758928.904415:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787758928.904429:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787758928.904456:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787758928.904474:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787758928.904489:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787758928.904515:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787758928.904528:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787758928.904540:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787758928.904554:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787758928.904566:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787758928.904576:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787758928.904588:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787758928.904599:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787758928.904626:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995594496:0@lo:502: 00000100:00100000:2.0:1787758928.904676:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758928.904703:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0091240 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.904730:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995594496 00000100:00100000:2.0:1787758928.904736:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995594496 00000100:00100000:2.0:1787758928.904770:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787758928.904778:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6933:x1874600995594496:12345-0@lo:502: 00000100:00100000:2.0:1787758928.904906:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6933:x1874600995594496:12345-0@lo:502: Request processed in 129us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.904913:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787758928.904964:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995594496:0@lo:502: 00000040:00080000:2.0:1787758928.905002:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787758928.905011:0:6933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787758928.914566:0:6961:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787758928.914619:0:6961:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff88b2fe524ed8) 00000020:00000080:0.0:1787758928.914648:0:6961:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787758928.914744:0:6961:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b301aae000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787758928.914749:0:6961:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88b301aae000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787758928.914752:0:6961:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88b301aae000 3 00010000:00080000:0.0:1787758928.920007:0:6961:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88b2fe247800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.133@tcp at head 00010000:00010000:0.0:1787758928.925936:0:6961:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787758928.926263:0:6961:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787758928.926317:0:6961:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787758928.926333:0:6961:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1a77009127f05018 00000100:00080000:0.0:1787758928.926345:0:6961:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787758928.926363:0:6961:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88b2fe247800 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:0.0:1787758928.926609:0:6961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b2e36d8f00 x1874600995594624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787758928.926641:0:6961:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787758928.926794:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3440:1874600995594624:0@lo:38: 00000100:00100000:1.0:1787758928.926909:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758928.927069:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995594624 00000100:00100000:0.0:1787758928.927078:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995594624 00000100:00100000:0.0:1787758928.927119:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787758928.927127:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3440:x1874600995594624:12345-0@lo:38: 00010000:00080000:0.0:1787758928.927160:0:5954:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1787758928.927216:0:5954:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1a77009127f0501f 00000004:00100000:0.0:1787758928.927247:0:5954:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787758928.927290:0:5954:0:(import.c:65:import_set_state_nolock()) ffff88b2fe244800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787758928.927361:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1874600995594624:12345-0@lo:38: Request processed in 233us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758928.927369:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787758928.928081:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88b2e36d8f00 x1874600995594624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787758938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758928.928097:0:3440:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787758928.928107:0:3440:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787758928.928115:0:3440:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787758928.928120:0:3440:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787758928.928123:0:3440:0:(import.c:65:import_set_state_nolock()) ffff88b2fe247800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787758928.928138:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3440:1874600995594624:0@lo:38: 00000100:00100000:0.0:1787758928.933697:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3442:1874600995594752:0@lo:400: 00000100:00100000:0.0:1787758928.933819:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.933911:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995594752 00000100:00100000:1.0:1787758928.933921:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995594752 00000100:00100000:1.0:1787758928.933980:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787758928.933990:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1874600995594752:12345-0@lo:400: 00000100:00100000:1.0:1787758928.944944:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1874600995594752:12345-0@lo:400: Request processed in 10938us (11108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.944966:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:1.0:1787758928.946483:0:6961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787758928.946621:0:6933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787758928.946658:0:6933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787758928.946678:0:6933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0500a expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.946692:0:6933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0500a expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787758928.946759:0:6933:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787758928.946762:0:6933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787758928.946764:0:6933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787758928.946765:0:6933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787758928.946766:0:6933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787758928.946768:0:6933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787758928.946769:0:6933:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787758928.946771:0:6933:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787758928.946773:0:6933:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787758928.946776:0:6933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787758928.946777:0:6933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787758928.946791:0:6933:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787758928.946794:0:6933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787758928.946796:0:6933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787758928.946797:0:6933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787758928.946799:0:6933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787758928.946800:0:6933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787758928.946801:0:6933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787758928.946802:0:6933:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787758928.946804:0:6933:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787758928.946805:0:6933:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787758928.946806:0:6933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787758928.946807:0:6933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787758928.946865:0:6933:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787758928.946888:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36eda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995594880:0@lo:253: 00000100:00100000:2.0:1787758928.946974:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758928.947021:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0091600 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.947058:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995594880 00000100:00100000:2.0:1787758928.947065:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995594880 00000100:00100000:2.0:1787758928.947113:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787758928.947123:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6933:x1874600995594880:12345-0@lo:253: 20000000:01000000:2.0:1787758928.947155:0:5946:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787758928.947173:0:5946:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1787758928.954615:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88b2e36ec000 x1874600995594752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758928.954640:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3442:1874600995594752:0@lo:400: 20000000:01000000:3.0:1787758928.958717:0:5946:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787758928.958739:0:5946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787758928.959155:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6933:x1874600995594880:12345-0@lo:253: Request processed in 12025us (12173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.959170:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787758928.959466:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36eda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6933:1874600995594880:0@lo:253: 10000000:01000000:2.0:1787758928.959494:0:6933:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787758928.959498:0:6933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787758928.959500:0:6933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787758928.959501:0:6933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787758928.959502:0:6933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787758928.959504:0:6933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787758928.959505:0:6933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787758928.959506:0:6933:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787758928.959509:0:6933:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787758928.959510:0:6933:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787758928.959512:0:6933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787758928.959513:0:6933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787758928.959530:0:6933:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787758928.966446:0:5969:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787758928.966460:0:5969:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787758928.966494:0:5969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.966519:0:5969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2e350c400/0x1a77009127f04f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04f77 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.966528:0:5969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.966587:0:5969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2e350c400/0x1a77009127f04f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f04f77 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.966606:0:5969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2e350c400/0x1a77009127f04f7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f04f77 expref: 12 pid: 5948 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.966624:0:5969:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa9e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5969:1874600995595008:0@lo:104: 00000100:00100000:1.0:1787758928.966715:0:5969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.966803:0:5969:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787758928.967823:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995595008 00000100:00100000:0.0:1787758928.967836:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995595008 00000100:00100000:0.0:1787758928.967927:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787758928.967938:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aab840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:5969:x1874600995595008:12345-0@lo:104: 00010000:00010000:0.0:1787758928.967958:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f04f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04f7e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968073:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787758928.968081:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aab840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:5969:x1874600995595008:12345-0@lo:104: Request processed in 145us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758928.968089:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787758928.968116:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787758928.968123:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f04f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04f7e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968131:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c13f7c00 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:0.0:1787758928.968137:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f04f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f04f7e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968147:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f04f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f04f7e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758928.968155:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f04f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f04f7e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758928.968162:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787758928.968200:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f04f77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f7e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968207:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758928.968230:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f04f77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f7e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968251:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f04f77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f7e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968285:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758928.968288:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758928.968290:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758928.968315:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995595136:0@lo:103: 00000100:00100000:0.0:1787758928.968358:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758928.968426:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995595136 00000100:00100000:0.0:1787758928.968430:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995595136 00010000:00010000:0.0:1787758928.968450:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2e350c400/0x1a77009127f04f7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04f77 expref: 13 pid: 5948 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.968474:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787758928.968480:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7276450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:3443:x1874600995595136:12345-0@lo:103: 00010000:00010000:0.0:1787758928.968491:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758928.968496:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2e350c400/0x1a77009127f04f7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04f77 expref: 13 pid: 5948 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968508:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2e350c400/0x1a77009127f04f7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f04f77 expref: 13 pid: 5948 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968527:0:5940:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968536:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787758928.968553:0:5940:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005801782s 00010000:00010000:0.0:1787758928.968558:0:5940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968575:0:5940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968582:0:5940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968590:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968595:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c13f7200 already unused, calling callback (ffffffffc0e68530) 00010000:00010000:0.0:1787758928.968600:0:5940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968609:0:5940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968620:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.968630:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787758928.968657:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7276450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:3443:x1874600995595136:12345-0@lo:103: Request processed in 177us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758928.968664:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787758928.968737:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995595136:0@lo:103: 00010000:00010000:3.0:1787758928.968913:0:5969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2e350c400/0x1a77009127f04f7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f04f77 expref: 12 pid: 5948 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758928.968926:0:5969:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa9e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5969:1874600995595008:0@lo:104: 00010000:00010000:3.0:1787758928.968948:0:5969:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.968958:0:5969:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.968964:0:5969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.968971:0:5969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05026 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1787758928.970772:0:6933:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787758928.971018:0:6933:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787758928.971216:0:6933:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787758928.971391:0:6933:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787758928.971657:0:6933:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1787758928.971881:0:6933:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1787758928.975823:0:6933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787758928.990176:0:6933:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787758928.990205:0:6933:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787758928.990254:0:6933:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787758928.990317:0:6933:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.133@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787758928.990345:0:6933:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787758928.990384:0:6933:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787758928.991193:0:6933:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787758928.991375:0:6933:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 10000000:01000000:1.0:1787758929.093104:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787758929.093118:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b2e05c4000 from 21 10000000:01000000:1.0:1787758929.093125:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787758929.093194:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.093208:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.093221:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758929.093263:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aabc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995595264:0@lo:101: 00000100:00100000:1.0:1787758929.093363:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758929.093447:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787758929.093475:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995595264 00000100:00100000:1.0:1787758929.093484:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995595264 00000100:00100000:1.0:1787758929.093555:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787758929.093567:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5950:x1874600995595264:12345-0@lo:101: 00010000:00010000:1.0:1787758929.093584:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758929.093601:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05034 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f0502d expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.093629:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f0502d expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.093653:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f0502d expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.093663:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c13f7200, rc 0) 00000100:00100000:1.0:1787758929.093708:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:5950:x1874600995595264:12345-0@lo:101: Request processed in 142us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758929.093716:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787758929.093803:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aabc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995595264:0@lo:101: 00010000:00010000:1.0:1787758929.093822:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05034 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.093833:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f05034 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758929.093933:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aabc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995595392:0@lo:501: 00000100:00100000:1.0:1787758929.093959:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758929.093973:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3600 going to sleep for 11 seconds 00000100:00100000:3.0:1787758929.094315:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995595392 00000100:00100000:3.0:1787758929.094336:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995595392 00000100:00100000:3.0:1787758929.094433:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787758929.094455:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:5950:x1874600995595392:12345-0@lo:501: 00000100:00100000:3.0:1787758929.094685:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:5950:x1874600995595392:12345-0@lo:501: Request processed in 240us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758929.094694:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787758929.094798:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aabc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995595392:0@lo:501: 00000100:00100000:3.0:1787758929.094897:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995595520:0@lo:503: 00000100:00100000:3.0:1787758929.095102:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758929.095152:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0091240 going to sleep for 11 seconds 00000100:00100000:3.0:1787758929.095174:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995595520 00000100:00100000:3.0:1787758929.095179:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995595520 00000100:00100000:3.0:1787758929.095213:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787758929.095224:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:5950:x1874600995595520:12345-0@lo:503: 00000100:00100000:3.0:1787758929.095335:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:5950:x1874600995595520:12345-0@lo:503: Request processed in 112us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758929.095345:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787758929.095531:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995595520:0@lo:503: 00000100:00100000:2.0:1787758929.105256:0:6968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36eda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6968:1874600995595648:0@lo:502: 00000100:00100000:2.0:1787758929.105359:0:6968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758929.106795:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995595648 00000100:00100000:1.0:1787758929.106805:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995595648 00000100:00100000:1.0:1787758929.106885:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787758929.106896:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6968:x1874600995595648:12345-0@lo:502: 00000100:00100000:1.0:1787758929.107067:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6968:x1874600995595648:12345-0@lo:502: Request processed in 173us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758929.107076:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787758929.107136:0:6968:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2cf3c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758929.107160:0:6968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36eda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6968:1874600995595648:0@lo:502: 00000100:00100000:1.0:1787758929.107234:0:6968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aab0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6968:1874600995595776:0@lo:502: 00000100:00100000:1.0:1787758929.107278:0:6968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758929.107309:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995595776 00000100:00100000:1.0:1787758929.107313:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995595776 00000100:00100000:1.0:1787758929.107336:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787758929.107342:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6968:x1874600995595776:12345-0@lo:502: 00000100:00100000:1.0:1787758929.107537:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:6968:x1874600995595776:12345-0@lo:502: Request processed in 195us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758929.107544:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787758929.107573:0:6968:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787758929.107587:0:6968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aab0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6968:1874600995595776:0@lo:502: 00000040:00080000:1.0:1787758929.107606:0:6968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787758929.107668:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787758929.107694:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787758929.107703:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05034 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.107715:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05034 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758929.107725:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787758929.107727:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88b2e05c4000 from 4 10000000:01000000:1.0:1787758929.107730:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787758929.107756:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.107763:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.107794:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758929.107806:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aab0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995595904:0@lo:101: 00000100:00100000:1.0:1787758929.107833:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758929.107866:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787758929.107878:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995595904 00000100:00100000:1.0:1787758929.107882:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995595904 00000100:00100000:1.0:1787758929.107904:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787758929.107910:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:5950:x1874600995595904:12345-0@lo:101: 00010000:00010000:1.0:1787758929.108175:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758929.108190:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c13f7800/0x1a77009127f05042 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f0503b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.108214:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c13f7800/0x1a77009127f05042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f0503b expref: 14 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.108224:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c13f7800/0x1a77009127f05042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f0503b expref: 14 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.108234:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c13f7800, rc 0) 00000100:00100000:1.0:1787758929.108314:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995595904:12345-0@lo:101: Request processed in 403us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758929.108321:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787758929.109659:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aab0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995595904:0@lo:101: 00010000:00010000:2.0:1787758929.109681:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05042 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758929.109693:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f05042 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758929.109793:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995596032:0@lo:256: 00000100:00100000:2.0:1787758929.109890:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758929.110509:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2cf3c89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758929.110545:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995596032 00000100:00100000:2.0:1787758929.110551:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995596032 00000100:00100000:2.0:1787758929.110625:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787758929.110633:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995596032:12345-0@lo:256: 20000000:01000000:2.0:1787758929.110655:0:5947:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787758929.110675:0:5947:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787758929.110678:0:5947:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787758929.110799:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995596032:12345-0@lo:256: Request processed in 166us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758929.110806:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787758929.110866:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995596032:0@lo:256: 10000000:01000000:2.0:1787758929.111113:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787758929.111122:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05042 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758929.111132:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05042 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758929.111141:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787758929.111144:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787758929.111147:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787758929.111174:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758929.111182:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758929.111203:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758929.111219:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995596160:0@lo:101: 00000100:00100000:2.0:1787758929.111249:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758929.111270:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2cf3c89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758929.111328:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995596160 00000100:00100000:1.0:1787758929.111334:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995596160 00000100:00100000:1.0:1787758929.111367:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787758929.111385:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995596160:12345-0@lo:101: 00010000:00010000:1.0:1787758929.111400:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758929.111414:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c13f6600/0x1a77009127f05050 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f05049 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.111435:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c13f6600/0x1a77009127f05050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f05049 expref: 15 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.111446:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c13f6600/0x1a77009127f05050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05049 expref: 15 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.111454:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c13f6600, rc 0) 00000100:00100000:1.0:1787758929.111492:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995596160:12345-0@lo:101: Request processed in 108us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758929.111498:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787758929.111540:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995596160:0@lo:101: 00010000:00010000:1.0:1787758929.111550:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05050 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.111559:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f05050 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758929.111617:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995596288:0@lo:501: 00000100:00100000:1.0:1787758929.111642:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758929.111655:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787758929.111665:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995596288 00000100:00100000:1.0:1787758929.111669:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995596288 00000100:00100000:1.0:1787758929.111692:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787758929.111698:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995596288:12345-0@lo:501: 00000100:00100000:1.0:1787758929.111834:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995596288:12345-0@lo:501: Request processed in 135us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758929.111863:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787758929.111901:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995596288:0@lo:501: 00000100:00100000:1.0:1787758929.117811:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995596416:0@lo:503: 00000100:00100000:1.0:1787758929.117937:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758929.117988:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787758929.118024:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995596416 00000100:00100000:1.0:1787758929.118030:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995596416 00000100:00100000:1.0:1787758929.118092:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787758929.118100:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995596416:12345-0@lo:503: 00000100:00100000:1.0:1787758929.118222:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995596416:12345-0@lo:503: Request processed in 122us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758929.118231:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787758929.118294:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995596416:0@lo:503: 00000100:00100000:1.0:1787758929.118726:0:6969:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6969:1874600995596544:0@lo:502: 00000100:00100000:1.0:1787758929.118765:0:6969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758929.118798:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995596544 00000100:00100000:1.0:1787758929.118803:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995596544 00000100:00100000:1.0:1787758929.118827:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787758929.118834:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:6969:x1874600995596544:12345-0@lo:502: 00000100:00100000:1.0:1787758929.119367:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:6969:x1874600995596544:12345-0@lo:502: Request processed in 530us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758929.119440:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787758929.119492:0:6969:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1787758929.119517:0:6969:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6969:1874600995596544:0@lo:502: 00000020:01000000:1.0:1787758929.119545:0:6969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787758929.119553:0:6969:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787758929.119563:0:6969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758929.119566:0:6969:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787758929.119573:0:6969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787758929.119578:0:6969:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.133@tcp to nid 0x20000c0a8cc85 (192.168.204.133@tcp) 00000020:01000000:1.0:1787758929.119618:0:6969:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787758929.119621:0:6969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787758929.119638:0:6969:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff88b2f5479a48) 00000020:00000080:1.0:1787758929.119661:0:6969:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787758929.119667:0:6969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787758929.119757:0:6969:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787758929.119763:0:6969:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787758929.119770:0:6969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a77009127f0505e 00010000:00080000:1.0:1787758929.119822:0:6969:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88b3019d5000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.133@tcp at head 00010000:00010000:1.0:1787758929.121318:0:6969:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787758929.150247:0:6969:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787758929.150274:0:6969:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787758929.150801:0:6969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787758929.152251:0:6969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787758929.153489:0:6969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787758929.153633:0:6969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787758929.156613:0:6971:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787758929.156622:0:6971:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787758929.158825:0:6969:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787758929.158858:0:6969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787758929.158911:0:6969:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787758929.158945:0:6969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a77009127f05065 00000100:00080000:1.0:1787758929.158956:0:6969:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787758929.158969:0:6969:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88b3019d5000 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:1.0:1787758929.159004:0:6969:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b2e4aa83c0 x1874600995596672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787758929.159041:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3440:1874600995596672:0@lo:8: 00000100:00100000:1.0:1787758929.159111:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758929.159196:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995596672 00000100:00100000:1.0:1787758929.159204:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995596672 00000100:00100000:1.0:1787758929.159242:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787758929.159250:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3440:x1874600995596672:12345-0@lo:8: 00010000:00080000:1.0:1787758929.159276:0:6940:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:1.0:1787758929.159305:0:6940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a77009127f0506c 00002000:00100000:1.0:1787758929.159336:0:6940:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88b2fe710000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787758929.159342:0:6940:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787758929.159346:0:6940:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787758929.160646:0:6940:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787758929.162278:0:6940:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787758929.162319:0:6940:0:(import.c:65:import_set_state_nolock()) ffff88b2fe713800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787758929.163083:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3440:x1874600995596672:12345-0@lo:8: Request processed in 3829us (3969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758929.163095:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787758929.163175:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff88b2e4aa83c0 x1874600995596672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787758939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758929.163187:0:3440:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787758929.163196:0:3440:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787758929.163205:0:3440:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787758929.163211:0:3440:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787758929.163222:0:3440:0:(import.c:65:import_set_state_nolock()) ffff88b3019d5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787758929.163237:0:3440:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787758929.163244:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3440:1874600995596672:0@lo:8: 00000100:00080000:1.0:1787758929.163270:0:6969:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787758929.163344:0:6969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787758929.163351:0:6969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758929.163353:0:6969:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787758929.163356:0:6969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787758929.163360:0:6969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758929.163361:0:6969:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787758929.163363:0:6969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787758929.163365:0:6969:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787758929.164500:0:6969:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6969:1874600995596800:0@lo:502: 00000100:00100000:1.0:1787758929.164569:0:6969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758929.164616:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995596800 00000100:00100000:1.0:1787758929.164622:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995596800 00000100:00100000:1.0:1787758929.164662:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787758929.164671:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:6969:x1874600995596800:12345-0@lo:502: 00000100:00100000:1.0:1787758929.164799:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:6969:x1874600995596800:12345-0@lo:502: Request processed in 129us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758929.164807:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787758929.164877:0:6969:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2d82370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758929.164894:0:6969:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:6969:1874600995596800:0@lo:502: 00000020:01000000:1.0:1787758929.164917:0:6969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787758929.166231:0:6969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758929.166237:0:6969:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787758929.166243:0:6969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787758929.166343:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787758929.167936:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787758929.167959:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05050 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.167971:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05050 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758929.167981:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787758929.167984:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88b300e3ced8 from 1 10000000:01000000:1.0:1787758929.167986:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787758929.168026:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.168035:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.168046:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758929.168071:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995596928:0@lo:101: 00000100:00100000:1.0:1787758929.168138:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758929.171521:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2d82370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758929.171566:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995596928 00000100:00100000:1.0:1787758929.171575:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995596928 00000100:00100000:1.0:1787758929.171628:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787758929.171638:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995596928:12345-0@lo:101: 00010000:00010000:1.0:1787758929.171655:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758929.171689:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0507a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f05073 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.171720:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0507a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f05073 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.171740:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0507a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05073 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.171750:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2fe4ce800, rc 0) 00000100:00100000:1.0:1787758929.171835:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995596928:12345-0@lo:101: Request processed in 198us (3696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758929.171859:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787758929.171920:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995596928:0@lo:101: 00010000:00010000:1.0:1787758929.171940:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0507a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.171950:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f0507a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758929.172027:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995597056:0@lo:501: 00000100:00100000:1.0:1787758929.172062:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758929.172089:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995597056 00000100:00100000:1.0:1787758929.172094:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995597056 00000100:00100000:1.0:1787758929.172120:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787758929.172126:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995597056:12345-0@lo:501: 00000100:00100000:1.0:1787758929.172202:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995597056:12345-0@lo:501: Request processed in 76us (141us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787758929.172209:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787758929.172233:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2d82370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758929.172244:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995597056:0@lo:501: 10000000:01000000:1.0:1787758929.172273:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787758929.172285:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0507a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758929.172293:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0507a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787758929.172689:0:6971:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787758929.172766:0:6971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 172441925418ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787758929.172786:0:6971:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787758929.177835:0:5931:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787758929.184114:0:6972:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787758929.184150:0:6972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a01a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1874600995597312:0@lo:7: 00000100:00100000:3.0:1787758929.184225:0:6972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758929.184277:0:6972:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d3cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787758929.184397:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995597184:0@lo:13: 00000100:00100000:1.0:1787758929.184499:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995597312 00000100:00100000:1.0:1787758929.184507:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995597312 00000100:00100000:0.0:1787758929.184515:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758929.184569:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995597184 00000100:00100000:2.0:1787758929.184575:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995597184 00000100:00100000:2.0:1787758929.184621:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787758929.184631:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3444:x1874600995597184:12345-0@lo:13: 00002000:00000024:2.0:1787758929.184652:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:2.0:1787758929.184698:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3444:x1874600995597184:12345-0@lo:13: Request processed in 68us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758929.184706:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787758929.184835:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787758929.184875:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff88b2e3a03480 x1874600995597184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758929.184876:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6972:x1874600995597312:12345-0@lo:7: 00000100:00100000:0.0:1787758929.184902:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995597184:0@lo:13: 00000100:00080000:3.0:1787758929.184976:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1787758929.198133:0:6942:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787758929.198143:0:6942:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787758929.198237:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6972:x1874600995597312:12345-0@lo:7: Request processed in 13361us (14008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758929.198249:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787758929.198418:0:6972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff88b2e3a01a40 x1874600995597312/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787758945 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758929.198444:0:6972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a01a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1874600995597312:0@lo:7: 00000004:00080000:0.0:1787758929.198463:0:6972:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787758929.198507:0:6972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36dbc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1874600995597440:0@lo:5: 00000100:00100000:0.0:1787758929.198548:0:6972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758929.198602:0:6972:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2cf3c86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758929.199228:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995597440 00000100:00100000:1.0:1787758929.199235:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995597440 00000100:00100000:1.0:1787758929.199285:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787758929.199295:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6972:x1874600995597440:12345-0@lo:5: 00002000:00080000:1.0:1787758929.199320:0:6940:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787758929.199324:0:6940:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1787758929.203016:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787758929.203037:0:6935:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787758929.208742:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6972:x1874600995597440:12345-0@lo:5: Request processed in 9441us (10187us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787758929.208765:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787758929.208889:0:6972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff88b2e36dbc00 x1874600995597440/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787758945 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758929.208903:0:6972:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787758929.208910:0:6972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36dbc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1874600995597440:0@lo:5: 00000004:00080000:0.0:1787758929.208927:0:6972:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787758929.208977:0:6972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36dbc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1874600995597568:0@lo:700: 00000100:00100000:0.0:1787758929.209019:0:6972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758929.209053:0:6972:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2cf3c86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758929.209119:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995597568 00000100:00100000:2.0:1787758929.209126:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995597568 00000100:00100000:2.0:1787758929.209176:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787758929.209187:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6972:x1874600995597568:12345-0@lo:700: 00000100:00100000:2.0:1787758929.209227:0:6948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36efc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6948:1874600995597696:0@lo:700: 00000100:00100000:2.0:1787758929.209266:0:6948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758929.209293:0:6948:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c9771000 going to sleep for 11 seconds 00000100:00100000:3.0:1787758929.209486:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995597696 00000100:00100000:3.0:1787758929.209492:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995597696 00000100:00100000:3.0:1787758929.209545:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787758929.209554:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6948:x1874600995597696:12345-0@lo:700: 00000100:00080000:2.0:1787758929.209902:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:0.0:1787758929.220554:0:5960:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787758929.236971:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6948:x1874600995597696:12345-0@lo:700: Request processed in 27400us (27684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758929.236994:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787758929.239451:0:6948:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88b2e36efc00 x1874600995597696/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787758945 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758929.239485:0:6948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36efc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6948:1874600995597696:0@lo:700: 40000000:02000000:0.0:1787758929.239503:0:6948:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1787758929.265185:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6972:x1874600995597568:12345-0@lo:700: Request processed in 55995us (56160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758929.265209:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787758929.265321:0:6972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff88b2e36dbc00 x1874600995597568/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787758945 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758929.265337:0:6972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36dbc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1874600995597568:0@lo:700: 00000004:02000040:0.0:1787758929.284383:0:6972:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787758929.297386:0:6972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36da580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1874600995597824:0@lo:5: 00000100:00100000:0.0:1787758929.297460:0:6972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758929.297489:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995597824 00000100:00100000:0.0:1787758929.297514:0:6972:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2cf3c8480 going to sleep for 11 seconds 00000100:00100000:1.0:1787758929.298625:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995597824 00000100:00100000:1.0:1787758929.298694:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787758929.298705:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6972:x1874600995597824:12345-0@lo:5: 00002000:00080000:1.0:1787758929.308391:0:6942:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787758929.308419:0:6942:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00010000:00010000:0.0:1787758929.316732:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758929.318729:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6972:x1874600995597824:12345-0@lo:5: Request processed in 20020us (21263us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787758929.318824:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787758929.318882:0:6972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2e36da580 x1874600995597824/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787758945 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758929.318902:0:6972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36da580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1874600995597824:0@lo:5: 00000004:00080000:0.0:1787758929.318916:0:6972:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000020:00000004:0.0:1787758929.934085:0:7019:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787758929.934309:0:7019:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787758930.332123:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758931.354780:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758932.377971:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758933.403836:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758934.365655:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995597952:0@lo:13: 00000100:00100000:1.0:1787758934.365741:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758934.365821:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995597952 00000100:00100000:1.0:1787758934.365827:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995597952 00000100:00100000:1.0:1787758934.365913:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787758934.365923:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1874600995597952:12345-0@lo:13: 00002000:00000024:1.0:1787758934.365953:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787758934.366000:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1874600995597952:12345-0@lo:13: Request processed in 79us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758934.366007:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787758934.366030:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787758934.366079:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2e4aa83c0 x1874600995597952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758934.366101:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995597952:0@lo:13: 00000100:00100000:0.0:1787758934.366336:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995598208:0@lo:400: 00000100:00100000:0.0:1787758934.366390:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758934.366415:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787758934.366421:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995598336:0@lo:400: 00000100:00100000:0.0:1787758934.366447:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758934.366480:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995598208 00000100:00100000:0.0:1787758934.366484:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995598208 00000100:00100000:0.0:1787758934.366523:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995598336 00000100:00100000:0.0:1787758934.366526:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995598336 00000100:00100000:0.0:1787758934.366545:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787758934.366551:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995598208:12345-0@lo:400: 00000100:00100000:0.0:1787758934.366591:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995598208:12345-0@lo:400: Request processed in 40us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758934.366598:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787758934.366611:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787758934.366617:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995598336:12345-0@lo:400: 00000100:00100000:0.0:1787758934.366644:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995598336:12345-0@lo:400: Request processed in 28us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758934.366650:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787758934.366691:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2e36da1c0 x1874600995598336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758934.366700:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995598336:0@lo:400: 00010000:00080000:0.0:1787758934.366712:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2e36dbc00 x1874600995598208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758934.366720:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995598208:0@lo:400: 00000100:00100000:1.0:1787758934.366898:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995598080:0@lo:400: 00000100:00100000:1.0:1787758934.366933:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787758934.366965:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787758934.367027:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995598080 00000100:00100000:0.0:1787758934.367032:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995598080 00000100:00100000:0.0:1787758934.367079:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787758934.367087:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:3442:x1874600995598080:12345-0@lo:400: 00000100:00100000:0.0:1787758934.367122:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:3442:x1874600995598080:12345-0@lo:400: Request processed in 37us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758934.367129:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787758934.367260:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995598080:0@lo:400: 00010000:00010000:0.0:1787758934.426359:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787758934.879206:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787758935.452130:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787758936.082939:0:7309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787758936.474050:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787758937.079328:0:7361:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787758937.079566:0:7361:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787758937.499428:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758938.524498:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758939.482059:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787758939.482107:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995598464:0@lo:400: 00000100:00100000:2.0:1787758939.482137:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787758939.482141:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995598720:0@lo:400: 00000100:00100000:2.0:1787758939.482154:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995598592:0@lo:400: 00000100:00100000:0.0:1787758939.482193:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758939.482193:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758939.482220:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758939.482538:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995598464 00000100:00100000:3.0:1787758939.482545:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995598464 00000100:00100000:3.0:1787758939.482605:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787758939.482616:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:3442:x1874600995598464:12345-0@lo:400: 00000100:00100000:3.0:1787758939.482666:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:3442:x1874600995598464:12345-0@lo:400: Request processed in 52us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758939.482674:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787758939.482722:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995598464:0@lo:400: 00000100:00100000:0.0:1787758939.482950:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787758939.482958:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995598848:0@lo:400: 00000100:00100000:0.0:1787758939.482989:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758939.483035:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995598720 00000100:00100000:0.0:1787758939.483039:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995598720 00000100:00100000:0.0:1787758939.483078:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995598592 00000100:00100000:0.0:1787758939.483091:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995598592 00000100:00100000:0.0:1787758939.483107:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787758939.483114:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995598720:12345-0@lo:400: 00000100:00100000:0.0:1787758939.483157:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995598720:12345-0@lo:400: Request processed in 44us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758939.483164:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787758939.483190:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787758939.483196:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995598592:12345-0@lo:400: 00000100:00100000:3.0:1787758939.483401:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995598848 00000100:00100000:3.0:1787758939.483405:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995598848 00000100:00100000:3.0:1787758939.483442:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787758939.483448:0:6942:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787758939.483451:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995598848:12345-0@lo:400: 00000100:00100000:1.0:1787758939.483459:0:6942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787758939.483493:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995598848:12345-0@lo:400: Request processed in 45us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758939.483500:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787758939.483519:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787758939.483527:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995598976:0@lo:13: 00000100:00100000:3.0:1787758939.483557:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758939.483606:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995598976 00000100:00100000:3.0:1787758939.483610:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995598976 00000100:00100000:3.0:1787758939.483638:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787758939.483646:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995598976:12345-0@lo:13: 00002000:00000024:3.0:1787758939.483686:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787758939.483730:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995598976:12345-0@lo:13: Request processed in 85us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758939.483748:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995598592:12345-0@lo:400: Request processed in 552us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758939.483755:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787758939.483780:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787758939.483785:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787758939.483813:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2fe6ca940 x1874600995598848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758939.483824:0:3443:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787758939.483860:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995598848:0@lo:400: 00010000:00080000:0.0:1787758939.483875:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2fe6c8f00 x1874600995598720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758939.483895:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995598720:0@lo:400: 00000100:00100000:3.0:1787758939.484424:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787758939.484465:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2e4aa83c0 x1874600995598976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758939.484483:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995598976:0@lo:13: 00010000:00080000:2.0:1787758939.488529:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2fe6c8b40 x1874600995598592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758939.488548:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995598592:0@lo:400: 00010000:00010000:2.0:1787758939.546251:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787758940.014739:0:7463:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787758940.014960:0:7463:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787758940.573117:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787758940.931748:0:7512:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787758940.931762:0:7512:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1787758941.596712:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758942.623537:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758943.645761:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758944.602242:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995599488:0@lo:400: 00000100:00100000:0.0:1787758944.602310:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758944.602364:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787758944.602369:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995599104:0@lo:400: 00000100:00100000:0.0:1787758944.602394:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758944.602421:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995599232:0@lo:400: 00000100:00100000:1.0:1787758944.603052:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995599616:0@lo:13: 00000100:00100000:1.0:1787758944.603084:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758944.603319:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758944.603339:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787758944.603346:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995599360:0@lo:400: 00000100:00100000:0.0:1787758944.603365:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758944.603724:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995599616 00000100:00100000:1.0:1787758944.603731:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995599616 00000100:00100000:1.0:1787758944.603786:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787758944.603794:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aaa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995599616:12345-0@lo:13: 00002000:00000024:1.0:1787758944.603822:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787758944.603883:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aaa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995599616:12345-0@lo:13: Request processed in 90us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758944.603890:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787758944.603909:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787758944.603954:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2e4aa9e00 x1874600995599616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758944.603972:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995599616:0@lo:13: 00000100:00100000:3.0:1787758944.607354:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995599104 00000100:00100000:3.0:1787758944.607366:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995599104 00000100:00100000:3.0:1787758944.607439:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787758944.607449:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:3441:x1874600995599104:12345-0@lo:400: 00000100:00100000:3.0:1787758944.607556:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:3441:x1874600995599104:12345-0@lo:400: Request processed in 109us (5160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758944.607564:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787758944.607602:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995599488 00000100:00100000:3.0:1787758944.607607:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995599488 00000100:00100000:3.0:1787758944.607799:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787758944.607806:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995599488:12345-0@lo:400: 00000100:00100000:3.0:1787758944.607871:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995599488:12345-0@lo:400: Request processed in 65us (5560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758944.607878:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787758944.608081:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995599104:0@lo:400: 00010000:00080000:3.0:1787758944.608111:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2fe6ca580 x1874600995599488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758944.608152:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995599488:0@lo:400: 00000100:00100000:3.0:1787758944.608201:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995599232 00000100:00100000:3.0:1787758944.608205:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995599232 00000100:00100000:3.0:1787758944.608350:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995599360 00000100:00100000:3.0:1787758944.608354:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995599360 00000100:00100000:3.0:1787758944.608380:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787758944.608386:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995599232:12345-0@lo:400: 00000100:00100000:3.0:1787758944.608420:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995599232:12345-0@lo:400: Request processed in 35us (5102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758944.608438:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787758944.608453:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787758944.608459:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995599360:12345-0@lo:400: 00000100:00100000:3.0:1787758944.608497:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995599360:12345-0@lo:400: Request processed in 39us (5131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758944.608503:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787758944.608656:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787758944.608883:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2fe6c9680 x1874600995599360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758944.608895:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995599360:0@lo:400: 00010000:00080000:0.0:1787758944.608907:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2fe6cbc00 x1874600995599232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758944.608915:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995599232:0@lo:400: 00010000:00010000:0.0:1787758944.670340:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758945.690745:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758946.717471:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758947.740150:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758948.762144:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758949.722597:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995599744:0@lo:400: 00000100:00100000:2.0:1787758949.722688:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758949.722730:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3444:1874600995599872:0@lo:400: 00000100:00100000:2.0:1787758949.722761:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995599744 00000100:00100000:0.0:1787758949.722764:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758949.722768:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995599744 00000100:00100000:0.0:1787758949.722794:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3441:1874600995600000:0@lo:400: 00000100:00100000:2.0:1787758949.722814:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787758949.722824:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:3443:x1874600995599744:12345-0@lo:400: 00000100:00100000:0.0:1787758949.722828:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758949.722864:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787758949.722869:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995600128:0@lo:400: 00000100:00100000:2.0:1787758949.722910:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:3443:x1874600995599744:12345-0@lo:400: Request processed in 88us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758949.722918:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787758949.722941:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758949.722967:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995599744:0@lo:400: 00000100:00100000:0.0:1787758949.722969:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995599872 00000100:00100000:0.0:1787758949.722972:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995599872 00000100:00100000:0.0:1787758949.725297:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995600000 00000100:00100000:0.0:1787758949.725311:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995600000 00000100:00100000:2.0:1787758949.726472:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787758949.726490:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1874600995599872:12345-0@lo:400: 00000100:00100000:2.0:1787758949.726597:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1874600995599872:12345-0@lo:400: Request processed in 113us (3831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758949.726604:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787758949.726628:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787758949.726636:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1874600995600000:12345-0@lo:400: 00000100:00100000:2.0:1787758949.726691:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1874600995600000:12345-0@lo:400: Request processed in 56us (3861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758949.726697:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787758949.726751:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995600256:0@lo:13: 00000100:00100000:2.0:1787758949.726791:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758949.726837:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995600256 00000100:00100000:2.0:1787758949.726859:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995600256 00000100:00100000:2.0:1787758949.726897:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787758949.726904:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995600256:12345-0@lo:13: 00002000:00000024:2.0:1787758949.726967:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1787758949.727002:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995600256:12345-0@lo:13: Request processed in 99us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758949.727008:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787758949.727044:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2e4aa9680 x1874600995600256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758949.727063:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995600256:0@lo:13: 00000100:00080000:1.0:1787758949.732976:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787758949.732987:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787758949.733249:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2fe6c9680 x1874600995599872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758949.733268:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3444:1874600995599872:0@lo:400: 00000100:00100000:1.0:1787758949.733385:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995600128 00000100:00100000:1.0:1787758949.733393:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995600128 00000100:00100000:1.0:1787758949.733449:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787758949.733460:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995600128:12345-0@lo:400: 00010000:00080000:2.0:1787758949.734630:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2fe6ca580 x1874600995600128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758949.734646:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995600128:0@lo:400: 00010000:00080000:2.0:1787758949.734661:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2fe6cbc00 x1874600995600000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758949.734670:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3441:1874600995600000:0@lo:400: 00000100:00100000:1.0:1787758949.735233:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995600128:12345-0@lo:400: Request processed in 1771us (12286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758949.735244:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787758949.787679:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758950.814218:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758951.838465:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787758952.003235:0:8010:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787758952.003240:0:8010:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787758952.003242:0:8010:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787758952.003404:0:8010:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88b2fe715800 00000020:01000004:1.0:1787758952.003423:0:8010:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787758952.003436:0:8010:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787758952.003451:0:8010:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff88b2f5478000) 00000020:00000080:1.0:1787758952.003467:0:8010:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787758952.057479:0:8010:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787758952.057542:0:8010:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1787758952.088597:0:8010:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787758952.088808:0:8010:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787758952.088821:0:8010:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787758952.088833:0:8010:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1a77009127f05088 00000020:01000004:0.0:1787758952.088870:0:8010:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787758952.088894:0:8010:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.133@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787758952.088898:0:8010:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787758952.088905:0:8010:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787758952.088939:0:8010:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787758952.088944:0:8010:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.133@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787758952.149387:0:8010:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.133@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787758952.149439:0:8010:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.133@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787758952.149443:0:8010:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787758952.149445:0:8010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787758952.149447:0:8010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758952.149448:0:8010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787758952.149450:0:8010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758952.149451:0:8010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758952.149453:0:8010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787758952.149454:0:8010:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787758952.149455:0:8010:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787758952.149457:0:8010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758952.149458:0:8010:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787758952.149474:0:8010:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787758952.149476:0:8010:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787758952.149478:0:8010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787758952.149478:0:8010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758952.149480:0:8010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787758952.149481:0:8010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758952.149482:0:8010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758952.149482:0:8010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787758952.149483:0:8010:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787758952.149484:0:8010:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787758952.149485:0:8010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758952.149485:0:8010:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787758952.149517:0:8010:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787758952.149534:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995600384:0@lo:253: 00000100:00100000:0.0:1787758952.149600:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.149651:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b300e08540 going to sleep for 11 seconds 00000100:00100000:1.0:1787758952.149746:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995600384 00000100:00100000:1.0:1787758952.149753:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995600384 00000100:00100000:1.0:1787758952.149812:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787758952.149822:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:8010:x1874600995600384:12345-0@lo:253: 20000000:01000000:1.0:1787758952.149882:0:5947:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787758952.149887:0:5947:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787758952.149893:0:5947:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787758952.149898:0:5947:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787758952.150140:0:5947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787758952.150274:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787758952.150289:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787758952.150308:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787758952.150314:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787758952.150338:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787758952.150356:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787758952.150436:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787758952.150451:0:5947:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.133@tcp 20000000:01000000:1.0:1787758952.150453:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.133@tcp (null) (null) (null) 00000040:00080000:1.0:1787758952.150468:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787758952.150482:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787758952.150502:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787758952.150508:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.133@tcp (null) (null) 00000040:00080000:1.0:1787758952.150521:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787758952.150528:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787758952.150541:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787758952.150569:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787758952.150952:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787758952.150964:0:5947:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.133@tcp 20000000:01000000:1.0:1787758952.150966:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.133@tcp (null) (null) (null) 00000040:00080000:1.0:1787758952.150981:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787758952.150986:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787758952.151000:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787758952.151004:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.133@tcp (null) (null) 00000040:00080000:1.0:1787758952.151017:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787758952.151024:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787758952.151037:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787758952.151053:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787758952.151066:0:5947:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787758952.151068:0:5947:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787758952.151072:0:5947:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787758952.151115:0:5947:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787758952.151117:0:5947:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787758952.158371:0:8016:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787758952.158691:0:8016:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787758952.158708:0:8016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787758952.162804:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787758952.163310:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787758952.163342:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787758952.163356:0:5947:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787758952.163360:0:5947:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787758952.164062:0:8017:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787758952.164097:0:8017:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787758952.164111:0:8017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787758952.164378:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787758952.164412:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787758952.164427:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787758952.164435:0:5947:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787758952.164443:0:5947:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787758952.165189:0:8018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787758952.165360:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787758952.165381:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787758952.165402:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787758952.165412:0:5947:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787758952.165414:0:5947:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787758952.165774:0:8019:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787758952.165797:0:8019:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787758952.165814:0:8019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787758952.166418:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787758952.166441:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787758952.166456:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:1.0:1787758952.166602:0:5947:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787758952.166624:0:5947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.166643:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2c151f800/0x1a77009127f04fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04fd9 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.166651:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2c13f7e00/0x1a77009127f0500a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05003 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.166658:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f0502d expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.166665:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2c13f6600/0x1a77009127f05050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05049 expref: 16 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.166672:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0507a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05073 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.166679:0:5947:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.166719:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0507a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f05073 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.166734:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0507a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f05073 expref: 16 pid: 5947 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758952.166763:0:5947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa9a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5947:1874600995600512:0@lo:104: 00000100:00100000:1.0:1787758952.166864:0:5947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787758952.166920:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2c13f6600/0x1a77009127f05050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f05049 expref: 16 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.166929:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2c13f6600/0x1a77009127f05050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f05049 expref: 16 pid: 5948 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758952.166936:0:5947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5947:1874600995600640:0@lo:104: 00000100:00100000:2.0:1787758952.167127:0:5937:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787758952.167143:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995600512 00000100:00100000:2.0:1787758952.167150:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995600512 00000100:00100000:2.0:1787758952.167246:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787758952.167257:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e0b2b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:5947:x1874600995600512:12345-0@lo:104: 00010000:00010000:2.0:1787758952.167271:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f0507a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758952.167324:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787758952.167339:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e0b2b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:5947:x1874600995600512:12345-0@lo:104: Request processed in 85us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758952.167347:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787758952.168167:0:5947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787758952.168221:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f0502d expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.168234:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05034 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f0502d expref: 16 pid: 5947 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758952.168245:0:5947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aab840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5947:1874600995600768:0@lo:104: 00000100:00100000:1.0:1787758952.168271:0:5947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787758952.168344:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787758952.168351:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f0507a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.168370:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c13f7000 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:3.0:1787758952.168374:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f0507a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.168382:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f0507a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787758952.168389:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f0507a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758952.168405:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787758952.168438:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0507a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.168445:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787758952.168478:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0507a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.168486:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7000/0x1a77009127f05073 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0507a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.168500:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758952.168502:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758952.168504:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758952.168512:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787758952.168524:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995600896:0@lo:103: 00000100:00100000:3.0:1787758952.168553:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.168585:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995600896 00000100:00100000:3.0:1787758952.168591:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995600896 00010000:00010000:3.0:1787758952.168620:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0507a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05073 expref: 17 pid: 5947 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758952.168645:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787758952.168651:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a03c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:3443:x1874600995600896:12345-0@lo:103: 00010000:00010000:3.0:1787758952.168661:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787758952.168666:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0507a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05073 expref: 17 pid: 5947 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.168676:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0507a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f05073 expref: 17 pid: 5947 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.168692:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787758952.168718:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a03c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:3443:x1874600995600896:12345-0@lo:103: Request processed in 67us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.168724:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787758952.168775:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995600896:0@lo:103: 00010000:00010000:1.0:1787758952.168979:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2c13f7e00/0x1a77009127f0500a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f05003 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.168988:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2c13f7e00/0x1a77009127f0500a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f05003 expref: 16 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758952.168996:0:5947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa9e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5947:1874600995601024:0@lo:104: 00000100:00100000:1.0:1787758952.169019:0:5947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787758952.176197:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2c151f800/0x1a77009127f04fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f04fd9 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.176237:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2c151f800/0x1a77009127f04fe0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f04fd9 expref: 16 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758952.176254:0:5947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5947:1874600995601152:0@lo:104: 00000100:00100000:1.0:1787758952.176315:0:5947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.176376:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995600640 00000100:00100000:0.0:1787758952.176384:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995600640 00000100:00100000:0.0:1787758952.176443:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995600768 00000100:00100000:0.0:1787758952.176447:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995600768 00000100:00100000:0.0:1787758952.176459:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995601024 00000100:00100000:0.0:1787758952.178040:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995601024 00000100:00100000:0.0:1787758952.178108:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787758952.178119:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+5:5947:x1874600995600640:12345-0@lo:104: 00010000:00010000:0.0:1787758952.178136:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f05050 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178223:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787758952.178229:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+5:5947:x1874600995600640:12345-0@lo:104: Request processed in 114us (10065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758952.178237:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787758952.178254:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787758952.178262:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aa9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+4:5947:x1874600995600768:12345-0@lo:104: 00010000:00010000:0.0:1787758952.178287:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f05034 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178323:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787758952.178339:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aa9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+4:5947:x1874600995600768:12345-0@lo:104: Request processed in 68us (10057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758952.178346:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787758952.178359:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787758952.178365:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aa8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:5947:x1874600995601024:12345-0@lo:104: 00010000:00010000:0.0:1787758952.178372:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f0500a expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178638:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787758952.178645:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aa8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:5947:x1874600995601024:12345-0@lo:104: Request processed in 281us (9625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758952.178652:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787758952.178677:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787758952.178683:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f05050 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178691:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c151ec00 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:0.0:1787758952.178696:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f05050 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178705:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f05050 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758952.178713:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f05050 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758952.178726:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787758952.178775:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05050 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178782:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758952.178802:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05050 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178809:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05050 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178823:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787758952.178826:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f05034 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178831:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c13f6a00 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:0.0:1787758952.178834:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f05034 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178866:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f05034 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758952.178872:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f05034 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758952.178877:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787758952.178892:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05034 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178897:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758952.178909:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05034 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178915:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c13f6a00/0x1a77009127f0502d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05034 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178927:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787758952.178930:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f0500a expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178936:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c151ea00 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:0.0:1787758952.178938:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f0500a expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.178944:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f0500a expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758952.179319:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f0500a expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758952.179326:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787758952.179353:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0500a expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.179358:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758952.179375:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0500a expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.179381:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05003 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0500a expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.179390:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758952.179547:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758952.179549:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758952.179571:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995601280:0@lo:103: 00000100:00100000:0.0:1787758952.179623:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.179659:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787758952.179666:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995601408:0@lo:103: 00000100:00100000:0.0:1787758952.179686:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.179719:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995601280 00000100:00100000:0.0:1787758952.179726:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995601280 00010000:00010000:0.0:1787758952.179751:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2c13f6600/0x1a77009127f05050 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05049 expref: 17 pid: 5948 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758952.179773:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995601408 00000100:00100000:0.0:1787758952.179776:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995601408 00010000:00010000:0.0:1787758952.179787:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05034 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f0502d expref: 18 pid: 5947 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758952.179800:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787758952.179807:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ca580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:3441:x1874600995601280:12345-0@lo:103: 00010000:00010000:0.0:1787758952.179820:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758952.179825:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2c13f6600/0x1a77009127f05050 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05049 expref: 18 pid: 5948 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.179837:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2c13f6600/0x1a77009127f05050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f05049 expref: 18 pid: 5948 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.179878:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787758952.179909:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ca580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:3441:x1874600995601280:12345-0@lo:103: Request processed in 103us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758952.179917:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787758952.179940:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787758952.179945:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6c9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:3441:x1874600995601408:12345-0@lo:103: 00010000:00010000:0.0:1787758952.181168:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758952.181175:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05034 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f0502d expref: 17 pid: 5947 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.181187:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05034 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f0502d expref: 17 pid: 5947 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.181202:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787758952.181244:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6c9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:3441:x1874600995601408:12345-0@lo:103: Request processed in 1298us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758952.181252:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787758952.181298:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995601408:0@lo:103: 00000100:00100000:0.0:1787758952.181309:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995601280:0@lo:103: 00010000:00010000:3.0:1787758952.181417:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758952.181424:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758952.181441:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995601536:0@lo:103: 00000100:00100000:3.0:1787758952.181485:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.181529:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995601536 00000100:00100000:3.0:1787758952.181535:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995601536 00010000:00010000:3.0:1787758952.181556:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2c13f7e00/0x1a77009127f0500a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05003 expref: 17 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758952.181582:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787758952.181589:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:3443:x1874600995601536:12345-0@lo:103: 00010000:00010000:3.0:1787758952.181598:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787758952.181612:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2c13f7e00/0x1a77009127f0500a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05003 expref: 17 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.181621:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2c13f7e00/0x1a77009127f0500a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f05003 expref: 17 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.181631:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787758952.181660:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:3443:x1874600995601536:12345-0@lo:103: Request processed in 71us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.181666:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787758952.181692:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995601536:0@lo:103: 00000100:00100000:1.0:1787758952.186785:0:5947:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c3fc3180 going to sleep for 11 seconds 00010000:00010000:1.0:1787758952.186831:0:5947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0507a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f05073 expref: 16 pid: 5947 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758952.186889:0:5947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa9a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5947:1874600995600512:0@lo:104: 00010000:00010000:1.0:1787758952.186904:0:5947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c13f6600/0x1a77009127f05050 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f05049 expref: 15 pid: 5948 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758952.186914:0:5947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5947:1874600995600640:0@lo:104: 00010000:00010000:1.0:1787758952.186924:0:5947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c13f7200/0x1a77009127f05034 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f0502d expref: 14 pid: 5947 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758952.186932:0:5947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aab840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5947:1874600995600768:0@lo:104: 00010000:00010000:1.0:1787758952.186941:0:5947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c13f7e00/0x1a77009127f0500a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f05003 expref: 13 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758952.186957:0:5947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa9e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5947:1874600995601024:0@lo:104: 00000100:00100000:0.0:1787758952.193587:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995601152 00000100:00100000:0.0:1787758952.193603:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995601152 00000100:00100000:0.0:1787758952.194095:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787758952.194107:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aaad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:5947:x1874600995601152:12345-0@lo:104: 00010000:00010000:0.0:1787758952.194129:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04fe0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.194233:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787758952.194239:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aaad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:5947:x1874600995601152:12345-0@lo:104: Request processed in 135us (17925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758952.194247:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787758952.194268:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787758952.194275:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04fe0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.194297:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c13f7a00 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:0.0:1787758952.194302:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f04fe0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.194311:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f04fe0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758952.194318:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f04fe0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758952.194325:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787758952.194376:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04fe0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.194383:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758952.194417:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04fe0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.194425:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7a00/0x1a77009127f04fd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04fe0 expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.194443:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758952.194445:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758952.194447:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758952.194470:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995601664:0@lo:103: 00000100:00100000:0.0:1787758952.194510:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758952.194715:0:5947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5947:1874600995601152:0@lo:104: 00010000:00010000:1.0:1787758952.194750:0:5947:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758952.199893:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995601664 00000100:00100000:3.0:1787758952.199909:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995601664 00010000:00010000:3.0:1787758952.199971:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2c151f800/0x1a77009127f04fe0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04fd9 expref: 13 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758952.200015:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787758952.200025:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:3444:x1874600995601664:12345-0@lo:103: 00010000:00010000:3.0:1787758952.200043:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787758952.200050:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2c151f800/0x1a77009127f04fe0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04fd9 expref: 13 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.200063:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2c151f800/0x1a77009127f04fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f04fd9 expref: 13 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.200082:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c151f800/0x1a77009127f04fe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f04fd9 expref: 13 pid: 5946 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.200099:0:5940:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.200124:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.200141:0:5940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.200148:0:5940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.200155:0:5940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.200162:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.200169:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2fe4cfa00 already unused, calling callback (ffffffffc0e68530) 00010000:00010000:3.0:1787758952.200173:0:5940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.200182:0:5940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.200198:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.200210:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787758952.200283:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:3444:x1874600995601664:12345-0@lo:103: Request processed in 260us (5773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.200290:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787758952.200345:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995601664:0@lo:103: 00010000:00010000:1.0:1787758952.201069:0:5947:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.201087:0:5947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.201093:0:5947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0508f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787758952.201107:0:5947:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787758952.214420:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:8010:x1874600995600384:12345-0@lo:253: Request processed in 64590us (64809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758952.214436:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787758952.214706:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995600384:0@lo:253: 10000000:01000000:0.0:1787758952.214723:0:8010:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787758952.214793:0:8010:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787758952.214795:0:8010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787758952.214796:0:8010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758952.214797:0:8010:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787758952.214799:0:8010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758952.214800:0:8010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758952.214802:0:8010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787758952.214804:0:8010:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787758952.214805:0:8010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758952.214807:0:8010:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787758952.215177:0:8010:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88b2fe715800 from lustre-OST0001 10000000:01000000:0.0:1787758952.215209:0:8010:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787758952.215212:0:8010:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787758952.215221:0:8010:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88b300e3ced8 local copy 10000000:01000000:0.0:1787758952.215234:0:8010:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787758952.215274:0:8010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.215286:0:8010:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.215297:0:8010:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758952.215316:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995601792:0@lo:101: 00000100:00100000:0.0:1787758952.215373:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.215459:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c85f50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758952.215822:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995601792 00000100:00100000:2.0:1787758952.215829:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995601792 00000100:00100000:2.0:1787758952.216143:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787758952.216153:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:8010:x1874600995601792:12345-0@lo:101: 00010000:00010000:2.0:1787758952.216167:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758952.216183:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c151ea00/0x1a77009127f0509d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f05096 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758952.216207:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c151ea00/0x1a77009127f0509d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f05096 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758952.216218:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c151ea00/0x1a77009127f0509d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05096 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758952.216251:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c151ea00, rc 0) 00000100:00100000:2.0:1787758952.216298:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:8010:x1874600995601792:12345-0@lo:101: Request processed in 147us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758952.216305:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787758952.216383:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995601792:0@lo:101: 00010000:00010000:0.0:1787758952.216408:0:8010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1a77009127f0509d expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.216418:0:8010:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1a77009127f0509d expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758952.216542:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995601920:0@lo:501: 00000100:00100000:0.0:1787758952.216874:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.217094:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c85f50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758952.217183:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995601920 00000100:00100000:3.0:1787758952.217189:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995601920 00000100:00100000:3.0:1787758952.217221:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787758952.217240:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:8010:x1874600995601920:12345-0@lo:501: 00000100:00100000:3.0:1787758952.217317:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:8010:x1874600995601920:12345-0@lo:501: Request processed in 78us (442us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787758952.217337:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787758952.217425:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995601920:0@lo:501: 10000000:01000000:0.0:1787758952.217438:0:8010:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787758952.217457:0:8010:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787758952.217473:0:8010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1a77009127f0509d expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.217483:0:8010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1a77009127f0509d expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.217490:0:8010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1a77009127f0509d expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.217511:0:8010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787758952.217561:0:8010:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88b2fe715800 10000000:01000000:0.0:1787758952.217566:0:8010:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787758952.217572:0:8010:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787758952.217574:0:8010:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787758952.217578:0:8010:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787758952.217581:0:8010:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787758952.217599:0:8010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.217606:0:8010:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.217628:0:8010:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758952.217640:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995602048:0@lo:101: 00000100:00100000:0.0:1787758952.217665:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.217676:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c85f5d80 going to sleep for 11 seconds 00010000:00010000:3.0:1787758952.217725:0:6955:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787758952.217731:0:6955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1a77009127f0509d expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.217745:0:6955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2e472a200 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:3.0:1787758952.217749:0:6955:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1a77009127f0509d expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.217758:0:6955:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1a77009127f0509d expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787758952.217765:0:6955:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1a77009127f0509d expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758952.217771:0:6955:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787758952.217789:0:6955:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1a77009127f0509d expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.217795:0:6955:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787758952.217818:0:6955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1a77009127f0509d expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.217825:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2e472a200/0x1a77009127f05096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1a77009127f0509d expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.217863:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758952.217865:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758952.217866:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758952.217874:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787758952.217885:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995602176:0@lo:103: 00000100:00100000:3.0:1787758952.217911:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.217941:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995602176 00000100:00100000:3.0:1787758952.217955:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995602176 00000100:00100000:3.0:1787758952.217987:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787758952.217992:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a01e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:3442:x1874600995602176:12345-0@lo:103: 00010000:00010000:3.0:1787758952.218003:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787758952.218015:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c151ea00/0x1a77009127f0509d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a77009127f05096 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.218028:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787758952.218055:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a01e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:3442:x1874600995602176:12345-0@lo:103: Request processed in 62us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.218061:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787758952.218085:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995602176:0@lo:103: 00000100:00100000:3.0:1787758952.218100:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995602048 00000100:00100000:3.0:1787758952.218103:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995602048 00000100:00100000:3.0:1787758952.218116:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787758952.218121:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+11:8010:x1874600995602048:12345-0@lo:101: 00010000:00010000:3.0:1787758952.218128:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758952.218138:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e350c400/0x1a77009127f050ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f050a4 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.218166:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e350c400/0x1a77009127f050ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f050a4 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.218176:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e350c400/0x1a77009127f050ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f050a4 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.218182:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e350c400, rc 0) 00000100:00100000:3.0:1787758952.218209:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:8010:x1874600995602048:12345-0@lo:101: Request processed in 87us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.218214:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787758952.218600:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995602048:0@lo:101: 00010000:00010000:0.0:1787758952.218612:0:8010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f050ab expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.218621:0:8010:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f050ab expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758952.218687:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995602304:0@lo:501: 00000100:00100000:0.0:1787758952.218714:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.218749:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c85f5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787758952.218972:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995602304 00000100:00100000:3.0:1787758952.218977:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995602304 00000100:00100000:3.0:1787758952.219000:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787758952.219006:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:8010:x1874600995602304:12345-0@lo:501: 00000100:00100000:3.0:1787758952.219110:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:8010:x1874600995602304:12345-0@lo:501: Request processed in 103us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.219117:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787758952.219268:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995602304:0@lo:501: 00000100:00100000:0.0:1787758952.219314:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995602432:0@lo:503: 00000100:00100000:0.0:1787758952.219361:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.219385:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c85f5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787758952.219603:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995602432 00000100:00100000:3.0:1787758952.219608:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995602432 00000100:00100000:3.0:1787758952.219626:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787758952.219631:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:8010:x1874600995602432:12345-0@lo:503: 00000100:00100000:3.0:1787758952.219708:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:8010:x1874600995602432:12345-0@lo:503: Request processed in 75us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.219715:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787758952.219908:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995602432:0@lo:503: 00000040:00080000:0.0:1787758952.220169:0:8010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787758952.220251:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995602560:0@lo:502: 00000100:00100000:0.0:1787758952.220284:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.220308:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c85f5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787758952.221083:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995602560 00000100:00100000:3.0:1787758952.221091:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995602560 00000100:00100000:3.0:1787758952.221127:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787758952.221145:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:8010:x1874600995602560:12345-0@lo:502: 00000100:00100000:3.0:1787758952.221272:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:8010:x1874600995602560:12345-0@lo:502: Request processed in 129us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.221279:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787758952.222268:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995602560:0@lo:502: 00000040:00080000:0.0:1787758952.222545:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787758952.222585:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787758952.222598:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787758952.222611:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787758952.222623:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787758952.222633:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787758952.222662:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995602688:0@lo:502: 00000100:00100000:0.0:1787758952.222721:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.224298:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c85f5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787758952.234863:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995602688 00000100:00100000:2.0:1787758952.234878:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995602688 00000100:00100000:2.0:1787758952.234966:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787758952.234976:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:8010:x1874600995602688:12345-0@lo:502: 00000100:00100000:2.0:1787758952.235177:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:8010:x1874600995602688:12345-0@lo:502: Request processed in 201us (12455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758952.235196:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787758952.235514:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995602688:0@lo:502: 00000040:00080000:0.0:1787758952.235612:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787758952.235626:0:8010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787758952.239665:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787758952.239679:0:8020:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787758952.239687:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787758952.239689:0:8020:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787758952.239696:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787758952.239714:0:8020:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff88b2fe271a48) 00000020:00000080:3.0:1787758952.239921:0:8020:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787758952.244082:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787758952.244216:0:8020:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b2fe715800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787758952.244339:0:8020:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787758952.244351:0:8020:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1a77009127f050b9 00010000:00010000:0.0:1787758952.261365:0:8020:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1787758952.262358:0:8020:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787758952.267524:0:8020:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787758952.268030:0:8020:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787758952.276176:0:8020:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1787758952.276376:0:8020:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787758952.286294:0:8020:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1787758952.290671:0:8020:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787758952.290687:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787758952.290696:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758952.290698:0:8020:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787758952.290703:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787758952.290708:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758952.290709:0:8020:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787758952.290713:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787758952.290715:0:8020:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787758952.290921:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787758952.290926:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758952.290928:0:8020:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787758952.290932:0:8020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787758952.294792:0:8010:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787758952.294871:0:8010:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787758952.295034:0:8010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f050ab expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.295049:0:8010:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f050ab expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758952.295058:0:8010:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b2fe715800 from 1 10000000:01000000:0.0:1787758952.295075:0:8010:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787758952.295116:0:8010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.295124:0:8010:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.295135:0:8010:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758952.295160:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995602816:0@lo:101: 00000100:00100000:0.0:1787758952.295244:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.295294:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c85f5600 going to sleep for 11 seconds 00000100:00100000:2.0:1787758952.295368:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995602816 00000100:00100000:2.0:1787758952.295377:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995602816 00000100:00100000:2.0:1787758952.295445:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787758952.295457:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:8010:x1874600995602816:12345-0@lo:101: 00010000:00010000:2.0:1787758952.295473:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758952.295489:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c151f800/0x1a77009127f050c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f050c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758952.295511:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c151f800/0x1a77009127f050c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f050c0 expref: 13 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758952.295521:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c151f800/0x1a77009127f050c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f050c0 expref: 13 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758952.295530:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c151f800, rc 0) 00000100:00100000:2.0:1787758952.295581:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:8010:x1874600995602816:12345-0@lo:101: Request processed in 127us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758952.295599:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787758952.295918:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995602816:0@lo:101: 00010000:00010000:0.0:1787758952.295933:0:8010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f050c7 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758952.295951:0:8010:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f050c7 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758952.296047:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995602944:0@lo:501: 00000100:00100000:0.0:1787758952.296077:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.296104:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c85f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787758952.296121:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995602944 00000100:00100000:0.0:1787758952.296125:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995602944 00000100:00100000:0.0:1787758952.296154:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787758952.296161:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:8010:x1874600995602944:12345-0@lo:501: 00000100:00100000:0.0:1787758952.296254:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:8010:x1874600995602944:12345-0@lo:501: Request processed in 93us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758952.296271:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787758952.296306:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995602944:0@lo:501: 00000100:00100000:0.0:1787758952.296351:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603072:0@lo:503: 00000100:00100000:0.0:1787758952.296400:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.296414:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c85f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787758952.296427:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995603072 00000100:00100000:0.0:1787758952.296430:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995603072 00000100:00100000:0.0:1787758952.296449:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787758952.296456:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:8010:x1874600995603072:12345-0@lo:503: 00000100:00100000:0.0:1787758952.296531:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:8010:x1874600995603072:12345-0@lo:503: Request processed in 74us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758952.296538:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787758952.296725:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603072:0@lo:503: 00000040:00080000:0.0:1787758952.296993:0:8010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787758952.297072:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603200:0@lo:502: 00000100:00100000:0.0:1787758952.297112:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.297127:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c85f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787758952.297142:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995603200 00000100:00100000:0.0:1787758952.297146:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995603200 00000100:00100000:0.0:1787758952.297183:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787758952.297190:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:8010:x1874600995603200:12345-0@lo:502: 00000100:00100000:0.0:1787758952.297270:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:8010:x1874600995603200:12345-0@lo:502: Request processed in 80us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758952.297277:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787758952.297317:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603200:0@lo:502: 00000040:00080000:0.0:1787758952.297528:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787758952.298504:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787758952.298543:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603328:0@lo:502: 00000100:00100000:0.0:1787758952.298671:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.298763:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c85f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1787758952.304029:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995603328 00000100:00100000:2.0:1787758952.304048:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995603328 00000100:00100000:0.0:1787758952.306191:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787758952.306205:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:8010:x1874600995603328:12345-0@lo:502: 00000100:00100000:0.0:1787758952.306434:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:8010:x1874600995603328:12345-0@lo:502: Request processed in 231us (7762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758952.306443:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787758952.306695:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603328:0@lo:502: 00000040:00080000:3.0:1787758952.307540:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787758952.307629:0:8010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787758952.308506:0:8024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787758952.308517:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758952.308519:0:8024:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787758952.308527:0:8024:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b2fe715800 00000020:00000080:0.0:1787758952.308529:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787758952.308541:0:8024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758952.308543:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758952.308614:0:8024:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787758952.308618:0:8024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787758952.309101:0:8010:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787758952.309130:0:8010:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787758952.309185:0:8010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f050c7 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.309198:0:8010:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f050c7 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758952.309252:0:8010:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787758952.309256:0:8010:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88b2fe715800 10000000:01000000:3.0:1787758952.309259:0:8010:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88b2fe715800 10000000:01000000:3.0:1787758952.309264:0:8010:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787758952.309272:0:8010:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b2fe715800 from 1 10000000:01000000:3.0:1787758952.309275:0:8010:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787758952.309311:0:8010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.309343:0:8010:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.309354:0:8010:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758952.309378:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a02580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603456:0@lo:101: 00000100:00100000:3.0:1787758952.309460:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.309505:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd180 going to sleep for 11 seconds 00000100:00100000:2.0:1787758952.310076:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995603456 00000100:00100000:2.0:1787758952.310084:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995603456 00000100:00100000:2.0:1787758952.310139:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787758952.310149:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:8010:x1874600995603456:12345-0@lo:101: 00010000:00010000:2.0:1787758952.310163:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758952.310176:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c151ec00/0x1a77009127f050d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f050ce expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758952.310199:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c151ec00/0x1a77009127f050d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f050ce expref: 14 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758952.310209:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c151ec00/0x1a77009127f050d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f050ce expref: 14 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758952.310218:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c151ec00, rc 0) 00000100:00100000:2.0:1787758952.310259:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8010:x1874600995603456:12345-0@lo:101: Request processed in 112us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758952.310267:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787758952.310405:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a02580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603456:0@lo:101: 00010000:00010000:3.0:1787758952.310421:0:8010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f050d5 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.310430:0:8010:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f050d5 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758952.310522:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a02580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603584:0@lo:501: 00000100:00100000:3.0:1787758952.310649:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.310676:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd180 going to sleep for 11 seconds 00000100:00100000:1.0:1787758952.310721:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995603584 00000100:00100000:1.0:1787758952.310725:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995603584 00000100:00100000:1.0:1787758952.310764:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787758952.310771:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8010:x1874600995603584:12345-0@lo:501: 00000100:00100000:1.0:1787758952.310907:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8010:x1874600995603584:12345-0@lo:501: Request processed in 136us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758952.310914:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787758952.311128:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a02580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603584:0@lo:501: 00000100:00100000:3.0:1787758952.311158:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a02580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603712:0@lo:503: 00000100:00100000:3.0:1787758952.311198:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758952.311270:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995603712 00000100:00100000:2.0:1787758952.311275:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995603712 00000100:00100000:3.0:1787758952.311469:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd180 going to sleep for 11 seconds 00000100:00100000:2.0:1787758952.311647:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787758952.311657:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8010:x1874600995603712:12345-0@lo:503: 00000100:00100000:2.0:1787758952.311790:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8010:x1874600995603712:12345-0@lo:503: Request processed in 135us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758952.311798:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787758952.312340:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a02580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603712:0@lo:503: 00000040:00080000:0.0:1787758952.312724:0:8010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787758952.313029:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603840:0@lo:502: 00000100:00100000:0.0:1787758952.313091:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.313169:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c85f5600 going to sleep for 11 seconds 00000100:00100000:2.0:1787758952.313278:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995603840 00000100:00100000:2.0:1787758952.313284:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995603840 00000100:00100000:3.0:1787758952.313383:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787758952.313400:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8010:x1874600995603840:12345-0@lo:502: 00000100:00100000:3.0:1787758952.313513:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8010:x1874600995603840:12345-0@lo:502: Request processed in 120us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.313520:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787758952.313726:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603840:0@lo:502: 00000040:00080000:0.0:1787758952.314069:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787758952.314101:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787758952.314127:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787758952.314143:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787758952.314174:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787758952.314190:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787758952.314205:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787758952.314217:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787758952.314229:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787758952.314242:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787758952.314256:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787758952.314270:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787758952.314283:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787758952.314296:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787758952.314309:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787758952.314320:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787758952.314347:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787758952.314362:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787758952.314377:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787758952.314404:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787758952.314432:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787758952.314448:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787758952.314461:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787758952.314474:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787758952.314487:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787758952.314501:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787758952.314514:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787758952.314526:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787758952.314537:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787758952.314662:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787758952.314678:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787758952.314689:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787758952.314699:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787758952.314710:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787758952.314720:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787758952.314796:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787758952.314821:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787758952.314877:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603968:0@lo:502: 00000100:00100000:0.0:1787758952.314931:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758952.315156:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c85f5600 going to sleep for 11 seconds 00000100:00100000:3.0:1787758952.315206:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995603968 00000100:00100000:3.0:1787758952.315214:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995603968 00000100:00100000:3.0:1787758952.315250:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787758952.315258:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8010:x1874600995603968:12345-0@lo:502: 00000100:00100000:3.0:1787758952.315423:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8010:x1874600995603968:12345-0@lo:502: Request processed in 165us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.315433:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787758952.315643:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995603968:0@lo:502: 00000040:00080000:0.0:1787758952.315692:0:8010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787758952.315700:0:8010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787758952.317689:0:8025:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787758952.317708:0:8025:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88b2fe523490) 00000020:00000080:0.0:1787758952.317731:0:8025:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787758952.317908:0:8025:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b2fe715800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787758952.317913:0:8025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88b2fe715800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787758952.317916:0:8025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88b2fe715800 3 00010000:00080000:0.0:1787758952.318092:0:8025:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88b2fec1f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.133@tcp at head 00010000:00010000:0.0:1787758952.321235:0:8025:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787758952.323115:0:8025:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787758952.323202:0:8025:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787758952.323644:0:8025:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1a77009127f050e3 00000100:00080000:0.0:1787758952.323937:0:8025:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787758952.324159:0:8025:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88b2fec1f800 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:0.0:1787758952.324230:0:8025:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b2fe6cb0c0 x1874600995604096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787758952.324314:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3440:1874600995604096:0@lo:38: 00000100:00100000:2.0:1787758952.324632:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787758952.326505:0:8025:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787758952.326926:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995604096 00000100:00100000:3.0:1787758952.326955:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995604096 00000100:00100000:3.0:1787758952.327042:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787758952.327068:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3440:x1874600995604096:12345-0@lo:38: 00010000:00080000:3.0:1787758952.327134:0:5953:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:3.0:1787758952.327207:0:5953:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1a77009127f050ea 00000004:00100000:3.0:1787758952.327244:0:5953:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787758952.327332:0:5953:0:(import.c:65:import_set_state_nolock()) ffff88b2c90d5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787758952.327812:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787758952.327831:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995604224:0@lo:400: 00000100:00100000:1.0:1787758952.327894:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758952.328065:0:5954:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787758952.328075:0:5954:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787758952.328681:0:5955:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787758952.328698:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995604224 00000100:00100000:0.0:1787758952.328707:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995604224 00000100:00100000:0.0:1787758952.328760:0:5955:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787758952.328768:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787758952.328784:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995604224:12345-0@lo:400: 00000100:00100000:0.0:1787758952.328868:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995604224:12345-0@lo:400: Request processed in 87us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758952.328876:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787758952.329245:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2e4aa83c0 x1874600995604224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758952.329276:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995604224:0@lo:400: 00000100:00100000:3.0:1787758952.332440:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1874600995604096:12345-0@lo:38: Request processed in 5371us (7792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.332459:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787758952.332517:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995604352:0@lo:400: 00000100:00100000:3.0:1787758952.332598:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.332642:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787758952.332650:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995604480:0@lo:400: 00000100:00100000:3.0:1787758952.332678:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.332721:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995604480 00000100:00100000:3.0:1787758952.332728:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995604480 00000100:00100000:3.0:1787758952.332794:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787758952.332804:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a01680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995604480:12345-0@lo:400: 00000100:00100000:3.0:1787758952.332890:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a01680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995604480:12345-0@lo:400: Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.332897:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787758952.332914:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787758952.332971:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2e4aab840 x1874600995604480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758952.332986:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995604480:0@lo:400: 00000040:00080000:0.0:1787758952.334097:0:8025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1787758952.334302:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995604352 00000100:00100000:1.0:1787758952.334309:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995604352 00000100:00100000:1.0:1787758952.334374:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787758952.334382:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995604352:12345-0@lo:400: 00000100:00100000:1.0:1787758952.334449:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995604352:12345-0@lo:400: Request processed in 68us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758952.334455:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787758952.335555:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:3.0:1787758952.336142:0:8010:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787758952.336192:0:8010:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787758952.336210:0:8010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f050d5 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.336224:0:8010:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f050d5 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787758952.336283:0:8010:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787758952.336286:0:8010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787758952.336287:0:8010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787758952.336289:0:8010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787758952.336290:0:8010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787758952.336292:0:8010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787758952.336293:0:8010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787758952.336295:0:8010:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787758952.336297:0:8010:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787758952.336298:0:8010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787758952.336300:0:8010:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787758952.336304:0:8010:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787758952.336307:0:8010:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787758952.336315:0:8010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787758952.336316:0:8010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787758952.336317:0:8010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787758952.336318:0:8010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787758952.336319:0:8010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787758952.336320:0:8010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787758952.336321:0:8010:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787758952.336322:0:8010:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787758952.336323:0:8010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787758952.336335:0:8010:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787758952.336366:0:8010:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787758952.336387:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995604608:0@lo:253: 00000100:00100000:3.0:1787758952.336523:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.336820:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dde40 going to sleep for 11 seconds 00010000:00080000:3.0:1787758952.336892:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2e4aa9e00 x1874600995604352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758952.336906:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995604352:0@lo:400: 00000100:00100000:3.0:1787758952.337011:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995604608 00000100:00100000:3.0:1787758952.337018:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995604608 00000100:00100000:3.0:1787758952.337065:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787758952.337074:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8010:x1874600995604608:12345-0@lo:253: 20000000:01000000:3.0:1787758952.337098:0:5948:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787758952.337111:0:5948:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1787758952.337284:0:8027:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff88b2e3a00000 x1874600995604736/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758952.337293:0:8027:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd240 going to sleep for 0 seconds 00010000:00080000:2.0:1787758952.339418:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2fe6cb0c0 x1874600995604096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787758962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758952.339439:0:3440:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787758952.339453:0:3440:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787758952.339464:0:3440:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787758952.339470:0:3440:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787758952.339476:0:3440:0:(import.c:65:import_set_state_nolock()) ffff88b2fec1f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787758952.339486:0:3440:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000086027dd7): req@ffff88b2e3a00000 x1874600995604736/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758952.339511:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3440:1874600995604096:0@lo:38: 00000100:00100000:3.0:1787758952.339820:0:8027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.339891:0:8027:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787758952.340069:0:5964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995604736 00000100:00100000:1.0:1787758952.340076:0:5964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995604736 00000100:00100000:1.0:1787758952.340134:0:5964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787758952.340144:0:5964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8027:x1874600995604736:12345-0@lo:901: 00000100:00100000:1.0:1787758952.340249:0:5964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8027:x1874600995604736:12345-0@lo:901: Request processed in 107us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758952.340256:0:5964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787758952.340364:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787758952.340397:0:8027:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b2e3a00000 x1874600995604736/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787758968 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758952.340422:0:8027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a00000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8027:1874600995604736:0@lo:901: 20000000:01000000:1.0:1787758952.361980:0:5948:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787758952.361998:0:5948:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787758952.362342:0:5969:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787758952.362347:0:5969:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787758952.362439:0:5969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.362458:0:5969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2c13f7800/0x1a77009127f05042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f0503b expref: 14 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.362467:0:5969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.362506:0:5969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2c13f7800/0x1a77009127f05042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f0503b expref: 14 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758952.362509:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8010:x1874600995604608:12345-0@lo:253: Request processed in 25435us (25986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758952.362519:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:3.0:1787758952.362520:0:5969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2c13f7800/0x1a77009127f05042 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f0503b expref: 14 pid: 5948 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758952.362531:0:5969:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a00000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5969:1874600995604864:0@lo:104: 00000100:00100000:0.0:1787758952.362720:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8010:1874600995604608:0@lo:253: 10000000:01000000:0.0:1787758952.362796:0:8010:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787758952.362801:0:8010:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787758952.362803:0:8010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787758952.362804:0:8010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758952.362806:0:8010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787758952.362807:0:8010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758952.362808:0:8010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758952.362809:0:8010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787758952.362811:0:8010:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787758952.362813:0:8010:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787758952.362814:0:8010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758952.362816:0:8010:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787758952.362835:0:8010:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787758952.363057:0:5969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.363098:0:5969:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd780 going to sleep for 11 seconds 00000100:00100000:2.0:1787758952.363276:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995604864 00000100:00100000:2.0:1787758952.363283:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995604864 00000100:00100000:2.0:1787758952.363345:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787758952.363354:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a03840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:5969:x1874600995604864:12345-0@lo:104: 00010000:00010000:2.0:1787758952.363369:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f05042 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758952.363767:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787758952.363775:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a03840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:5969:x1874600995604864:12345-0@lo:104: Request processed in 422us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758952.363782:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787758952.366124:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787758952.366157:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f05042 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.366168:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c13f7c00 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:1.0:1787758952.366173:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f05042 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.366183:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f05042 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787758952.366190:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f05042 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758952.366196:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787758952.366256:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05042 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.366263:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787758952.366285:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05042 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.366291:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c13f7c00/0x1a77009127f0503b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05042 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.366312:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758952.366314:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758952.366316:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758952.366357:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995604992:0@lo:103: 00000100:00100000:1.0:1787758952.366445:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758952.366511:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995604992 00000100:00100000:1.0:1787758952.366517:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995604992 00010000:00010000:1.0:1787758952.366862:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2c13f7800/0x1a77009127f05042 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f0503b expref: 14 pid: 5948 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758952.366895:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787758952.366905:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7275450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:3441:x1874600995604992:12345-0@lo:103: 00010000:00010000:1.0:1787758952.366918:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758952.366924:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2c13f7800/0x1a77009127f05042 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f0503b expref: 14 pid: 5948 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.366935:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2c13f7800/0x1a77009127f05042 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f0503b expref: 14 pid: 5948 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.366964:0:5938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.366972:0:5938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787758952.366988:0:5938:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005801782s 00010000:00010000:1.0:1787758952.366993:0:5938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.367001:0:5938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.367008:0:5938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.367015:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.367020:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2e350da00 already unused, calling callback (ffffffffc0e68530) 00010000:00010000:1.0:1787758952.367030:0:5938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.367039:0:5938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.367047:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758952.367059:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787758952.367101:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7275450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:3441:x1874600995604992:12345-0@lo:103: Request processed in 198us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758952.367109:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787758952.367186:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995604992:0@lo:103: 00010000:00010000:3.0:1787758952.369246:0:5969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c13f7800/0x1a77009127f05042 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f0503b expref: 13 pid: 5948 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758952.369274:0:5969:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a00000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5969:1874600995604864:0@lo:104: 00010000:00010000:3.0:1787758952.369305:0:5969:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.369316:0:5969:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.369351:0:5969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758952.369358:0:5969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2e350da00/0x1a77009127f050f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1787758952.376217:0:8010:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787758952.376492:0:8010:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787758952.377079:0:8010:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787758952.377264:0:8010:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787758952.377697:0:8010:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1787758952.378219:0:8010:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1787758952.380272:0:8010:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787758952.396475:0:8010:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787758952.396486:0:8010:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787758952.396529:0:8010:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787758952.396585:0:8010:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.133@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787758952.396611:0:8010:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787758952.396645:0:8010:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787758952.397474:0:8010:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787758952.397653:0:8010:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787758952.859215:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787758953.434364:0:8080:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787758953.434579:0:8080:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787758953.883827:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758954.844142:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995605120:0@lo:13: 00000100:00100000:2.0:1787758954.844215:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758954.844604:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995605120 00000100:00100000:1.0:1787758954.844612:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995605120 00000100:00100000:1.0:1787758954.844681:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787758954.844692:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995605120:12345-0@lo:13: 00002000:00000024:1.0:1787758954.844721:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787758954.844772:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995605120:12345-0@lo:13: Request processed in 82us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758954.844778:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787758954.844831:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e4aa8f00 x1874600995605120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758954.844874:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995605120:0@lo:13: 00000100:00080000:3.0:1787758954.845146:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787758954.906874:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758955.931559:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758956.958037:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758957.412550:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3441:1874600995605504:0@lo:400: 00000100:00100000:2.0:1787758957.412622:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758957.412683:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787758957.412689:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995605632:0@lo:400: 00000100:00100000:2.0:1787758957.412738:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758957.412783:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995605504 00000100:00100000:2.0:1787758957.412790:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995605504 00000100:00100000:0.0:1787758957.412937:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3444:1874600995605376:0@lo:400: 00000100:00100000:0.0:1787758957.412969:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758957.412997:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787758957.413003:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995605248:0@lo:400: 00000100:00100000:0.0:1787758957.413029:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758957.413052:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3444:1874600995605760:0@lo:400: 00000100:00100000:0.0:1787758957.413077:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758957.413105:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995605248 00000100:00100000:0.0:1787758957.413116:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995605248 00000100:00100000:0.0:1787758957.413147:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787758957.413156:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:3444:x1874600995605248:12345-0@lo:400: 00000100:00100000:0.0:1787758957.413203:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:3444:x1874600995605248:12345-0@lo:400: Request processed in 48us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758957.413209:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787758957.413255:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995605376 00000100:00100000:0.0:1787758957.413259:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995605376 00000100:00100000:0.0:1787758957.413274:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995605760 00000100:00100000:0.0:1787758957.413276:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995605760 00000100:00100000:0.0:1787758957.413291:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787758957.413298:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e1171a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1874600995605504:12345-0@lo:400: 00000100:00100000:0.0:1787758957.413340:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e1171a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1874600995605504:12345-0@lo:400: Request processed in 43us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758957.413346:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787758957.413358:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787758957.413364:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1874600995605376:12345-0@lo:400: 00000100:00100000:0.0:1787758957.413389:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1874600995605376:12345-0@lo:400: Request processed in 25us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758957.413395:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787758957.413406:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787758957.413411:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1874600995605760:12345-0@lo:400: 00000100:00100000:0.0:1787758957.413436:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1874600995605760:12345-0@lo:400: Request processed in 24us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758957.413441:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787758957.413469:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995605248:0@lo:400: 00010000:00080000:0.0:1787758957.413483:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e36efc00 x1874600995605760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758957.413501:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3444:1874600995605760:0@lo:400: 00010000:00080000:0.0:1787758957.413512:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e36ecf00 x1874600995605376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758957.413519:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3444:1874600995605376:0@lo:400: 00000100:00080000:3.0:1787758957.413699:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787758957.413713:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995605632 00000100:00100000:3.0:1787758957.413717:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995605632 00000100:00100000:3.0:1787758957.413764:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787758957.413772:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995605632:12345-0@lo:400: 00000100:00100000:3.0:1787758957.413807:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995605632:12345-0@lo:400: Request processed in 37us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758957.413813:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787758957.413874:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e36ec000 x1874600995605632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758957.413883:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995605632:0@lo:400: 00010000:00080000:3.0:1787758957.413894:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e36eed00 x1874600995605504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758957.413910:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3441:1874600995605504:0@lo:400: 00000100:00080000:0.0:1787758957.414121:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787758957.985104:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758959.004088:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787758959.274789:0:8370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1787758959.962023:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787758959.962032:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b301aae000 from 30 10000000:01000000:2.0:1787758959.962038:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:3.0:1787758959.962045:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995605888:0@lo:13: 00010000:00010000:2.0:1787758959.962069:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758959.962079:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758959.962089:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758959.962102:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6ad2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995606016:0@lo:101: 00000100:00100000:3.0:1787758959.962116:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758959.962132:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758959.962168:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2fed44240 going to sleep for 11 seconds 00000100:00100000:1.0:1787758959.962217:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995605888 00000100:00100000:1.0:1787758959.962224:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995605888 00000100:00100000:1.0:1787758959.962281:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787758959.962291:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995605888:12345-0@lo:13: 00002000:00000024:1.0:1787758959.962319:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787758959.962360:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995605888:12345-0@lo:13: Request processed in 71us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758959.962367:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787758959.962387:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995606016 00000100:00100000:1.0:1787758959.962391:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995606016 00000100:00100000:1.0:1787758959.962411:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787758959.962417:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:5950:x1874600995606016:12345-0@lo:101: 00010000:00010000:1.0:1787758959.962425:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758959.962437:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2fe4ce600/0x1a77009127f050ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f050f8 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.962457:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2fe4ce600/0x1a77009127f050ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f050f8 expref: 14 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.962468:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2fe4ce600/0x1a77009127f050ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f050f8 expref: 14 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.962477:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2fe4ce600, rc 0) 00000100:00100000:1.0:1787758959.962505:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995606016:12345-0@lo:101: Request processed in 88us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758959.962511:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1787758959.962534:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787758959.962595:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6ad2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995606016:0@lo:101: 00010000:00010000:2.0:1787758959.962609:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f050ff expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758959.962617:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f050ff expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758959.962676:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6ad2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995606144:0@lo:501: 00000100:00100000:2.0:1787758959.962697:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758959.962752:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2fed44240 going to sleep for 11 seconds 00010000:00080000:3.0:1787758959.963782:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e4aa83c0 x1874600995605888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758959.963813:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995605888:0@lo:13: 00000100:00100000:1.0:1787758959.965362:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995606144 00000100:00100000:1.0:1787758959.965373:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995606144 00000100:00100000:1.0:1787758959.965463:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787758959.965474:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995606144:12345-0@lo:501: 00000100:00100000:1.0:1787758959.965652:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995606144:12345-0@lo:501: Request processed in 180us (2952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758959.965660:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787758959.965733:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6ad2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995606144:0@lo:501: 00000100:00100000:0.0:1787758959.965777:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995606272:0@lo:503: 00000100:00100000:0.0:1787758959.965822:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758959.965873:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995606272 00000100:00100000:3.0:1787758959.965878:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995606272 00000100:00100000:0.0:1787758959.965880:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b35cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758959.965913:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787758959.965930:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995606272:12345-0@lo:503: 00000100:00100000:3.0:1787758959.966015:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995606272:12345-0@lo:503: Request processed in 86us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758959.966022:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787758959.966058:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995606272:0@lo:503: 00000100:00100000:1.0:1787758959.967146:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8402:1874600995606400:0@lo:502: 00000100:00100000:1.0:1787758959.967207:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758959.967268:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301a0c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758959.967312:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995606400 00000100:00100000:3.0:1787758959.967318:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995606400 00000100:00100000:3.0:1787758959.967347:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787758959.967353:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8402:x1874600995606400:12345-0@lo:502: 00000100:00100000:3.0:1787758959.967498:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8402:x1874600995606400:12345-0@lo:502: Request processed in 145us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758959.967506:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787758959.967531:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8402:1874600995606400:0@lo:502: 00000100:00100000:0.0:1787758959.967572:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8402:1874600995606528:0@lo:502: 00000100:00100000:0.0:1787758959.967610:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758959.967638:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b35240 going to sleep for 11 seconds 00000100:00100000:3.0:1787758959.967680:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995606528 00000100:00100000:3.0:1787758959.967684:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995606528 00000100:00100000:3.0:1787758959.967714:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787758959.967720:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8402:x1874600995606528:12345-0@lo:502: 00000100:00100000:3.0:1787758959.967825:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8402:x1874600995606528:12345-0@lo:502: Request processed in 103us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758959.967832:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787758959.969189:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8402:1874600995606528:0@lo:502: 00000040:00080000:0.0:1787758959.969348:0:8402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787758959.969525:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787758959.969549:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787758959.969559:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f050ff expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758959.969570:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f050ff expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758959.969579:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787758959.969581:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787758959.969583:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787758959.969612:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758959.969620:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758959.969628:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758959.969720:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6afc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995606656:0@lo:101: 00000100:00100000:2.0:1787758959.969770:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758959.972765:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2fed44600 going to sleep for 11 seconds 00000100:00100000:3.0:1787758959.972978:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995606656 00000100:00100000:3.0:1787758959.972987:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995606656 00000100:00100000:3.0:1787758959.973080:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787758959.973091:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995606656:12345-0@lo:101: 00010000:00010000:3.0:1787758959.973108:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758959.973125:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e350cc00/0x1a77009127f0510d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f05106 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758959.973153:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e350cc00/0x1a77009127f0510d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f05106 expref: 15 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758959.973165:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e350cc00/0x1a77009127f0510d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05106 expref: 15 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758959.973173:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e350cc00, rc 0) 00000100:00100000:3.0:1787758959.973246:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995606656:12345-0@lo:101: Request processed in 158us (3476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758959.973253:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787758959.973378:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6afc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995606656:0@lo:101: 00010000:00010000:2.0:1787758959.973397:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0510d expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758959.973418:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f0510d expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758959.973493:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6afc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995606784:0@lo:501: 00000100:00100000:2.0:1787758959.973526:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758959.976472:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2fed44600 going to sleep for 11 seconds 00000100:00100000:1.0:1787758959.977403:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995606784 00000100:00100000:1.0:1787758959.977413:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995606784 00000100:00100000:1.0:1787758959.977463:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787758959.977472:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995606784:12345-0@lo:501: 00000100:00100000:1.0:1787758959.977747:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995606784:12345-0@lo:501: Request processed in 275us (4220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758959.977755:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787758959.978085:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6afc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995606784:0@lo:501: 00000100:00100000:0.0:1787758959.978134:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995606912:0@lo:503: 00000100:00100000:0.0:1787758959.978195:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758959.978228:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b35240 going to sleep for 11 seconds 00000100:00100000:1.0:1787758959.978270:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995606912 00000100:00100000:1.0:1787758959.978274:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995606912 00000100:00100000:1.0:1787758959.978295:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787758959.978300:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995606912:12345-0@lo:503: 00000100:00100000:1.0:1787758959.978386:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995606912:12345-0@lo:503: Request processed in 85us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758959.978402:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787758959.978466:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995606912:0@lo:503: 00000100:00100000:0.0:1787758959.978895:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8404:1874600995607040:0@lo:502: 00000100:00100000:0.0:1787758959.979128:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758959.979157:0:8404:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b35cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758959.979202:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995607040 00000100:00100000:1.0:1787758959.979206:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995607040 00000100:00100000:1.0:1787758959.979227:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787758959.979234:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:8404:x1874600995607040:12345-0@lo:502: 00000100:00100000:1.0:1787758959.979319:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:8404:x1874600995607040:12345-0@lo:502: Request processed in 85us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758959.979326:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787758959.979390:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8404:1874600995607040:0@lo:502: 00000020:01000000:0.0:1787758959.979412:0:8404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787758959.979420:0:8404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758959.979423:0:8404:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787758959.979428:0:8404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787758959.979431:0:8404:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787758959.979445:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8404:1874600995607168:0@lo:502: 00000100:00100000:0.0:1787758959.979477:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758959.979496:0:8404:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b35cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758959.979532:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995607168 00000100:00100000:1.0:1787758959.979536:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995607168 00000100:00100000:1.0:1787758959.979553:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787758959.979559:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:8404:x1874600995607168:12345-0@lo:502: 00000100:00100000:1.0:1787758959.979622:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:8404:x1874600995607168:12345-0@lo:502: Request processed in 62us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758959.979629:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787758959.979744:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8404:1874600995607168:0@lo:502: 00000020:01000000:0.0:1787758959.979760:0:8404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758959.979764:0:8404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758959.979766:0:8404:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787758959.979770:0:8404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1787758959.980095:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787758959.980116:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787758959.980125:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0510d expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.980135:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0510d expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758959.980145:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787758959.980148:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b2e05c4000 from 30 10000000:01000000:1.0:1787758959.980151:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787758959.980185:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.980204:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.980214:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758959.980225:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995607296:0@lo:101: 00000100:00100000:1.0:1787758959.980254:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758959.980283:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301a0c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758959.980323:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995607296 00000100:00100000:0.0:1787758959.980328:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995607296 00000100:00100000:0.0:1787758959.980349:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787758959.980355:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995607296:12345-0@lo:101: 00010000:00010000:0.0:1787758959.980363:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758959.980374:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e472a600/0x1a77009127f0511b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f05114 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758959.980393:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e472a600/0x1a77009127f0511b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f05114 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758959.980414:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e472a600/0x1a77009127f0511b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05114 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758959.980423:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e472a600, rc 0) 00000100:00100000:0.0:1787758959.980491:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995607296:12345-0@lo:101: Request processed in 136us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758959.980498:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787758959.980747:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995607296:0@lo:101: 00010000:00010000:1.0:1787758959.980760:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0511b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.980769:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f0511b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758959.980824:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995607424:0@lo:501: 00000100:00100000:1.0:1787758959.981098:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758959.981157:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301a0c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758959.981226:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995607424 00000100:00100000:0.0:1787758959.981230:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995607424 00000100:00100000:0.0:1787758959.981252:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787758959.981258:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995607424:12345-0@lo:501: 00000100:00100000:0.0:1787758959.981363:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995607424:12345-0@lo:501: Request processed in 105us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758959.981370:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787758959.981428:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995607424:0@lo:501: 00000100:00100000:1.0:1787758959.981452:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995607552:0@lo:503: 00000100:00100000:1.0:1787758959.981486:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758959.981509:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301a0c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758959.981545:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995607552 00000100:00100000:0.0:1787758959.981549:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995607552 00000100:00100000:0.0:1787758959.981576:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787758959.981582:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995607552:12345-0@lo:503: 00000100:00100000:0.0:1787758959.981660:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995607552:12345-0@lo:503: Request processed in 77us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758959.981666:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787758959.981786:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995607552:0@lo:503: 00000100:00100000:1.0:1787758959.982663:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8405:1874600995607680:0@lo:502: 00000100:00100000:1.0:1787758959.982708:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758959.982739:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301a0c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787758959.982891:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995607680 00000100:00100000:0.0:1787758959.982897:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995607680 00000100:00100000:0.0:1787758959.982931:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787758959.982938:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:8405:x1874600995607680:12345-0@lo:502: 00000100:00100000:0.0:1787758959.983030:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:8405:x1874600995607680:12345-0@lo:502: Request processed in 92us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758959.983044:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787758959.983157:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8405:1874600995607680:0@lo:502: 00000100:00100000:3.0:1787758959.983211:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8405:1874600995607808:0@lo:502: 00000100:00100000:3.0:1787758959.983248:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758959.983270:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787758959.983309:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995607808 00000100:00100000:1.0:1787758959.983314:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995607808 00000100:00100000:1.0:1787758959.983344:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787758959.983351:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:8405:x1874600995607808:12345-0@lo:502: 00000100:00100000:1.0:1787758959.983424:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:8405:x1874600995607808:12345-0@lo:502: Request processed in 72us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758959.983431:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787758959.983914:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8405:1874600995607808:0@lo:502: 00000040:00080000:3.0:1787758959.983937:0:8405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787758959.984045:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787758959.984067:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787758959.984076:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0511b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.984087:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0511b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758959.984096:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787758959.984099:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88b2e05c4000 from 5 10000000:01000000:1.0:1787758959.984102:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787758959.984129:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cf400/0x1a77009127f05122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.984138:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cf400/0x1a77009127f05122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.984147:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cf400/0x1a77009127f05122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758959.984160:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995607936:0@lo:101: 00000100:00100000:1.0:1787758959.984209:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758959.984240:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301a0c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758959.984245:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995607936 00000100:00100000:0.0:1787758959.984249:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995607936 00000100:00100000:0.0:1787758959.984275:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787758959.984282:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995607936:12345-0@lo:101: 00010000:00010000:0.0:1787758959.984291:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758959.984304:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e472b600/0x1a77009127f05129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f05122 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758959.984323:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e472b600/0x1a77009127f05129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f05122 expref: 17 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758959.984333:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e472b600/0x1a77009127f05129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05122 expref: 17 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758959.984341:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e472b600, rc 0) 00000100:00100000:0.0:1787758959.984379:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995607936:12345-0@lo:101: Request processed in 97us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758959.984385:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787758959.984416:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995607936:0@lo:101: 00010000:00010000:1.0:1787758959.984428:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cf400/0x1a77009127f05122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05129 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.984437:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cf400/0x1a77009127f05122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f05129 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758959.984480:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995608064:0@lo:256: 00000100:00100000:1.0:1787758959.984508:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758959.984529:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301a0c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758959.984956:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995608064 00000100:00100000:0.0:1787758959.984961:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995608064 00000100:00100000:0.0:1787758959.985045:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787758959.985054:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995608064:12345-0@lo:256: 20000000:01000000:0.0:1787758959.985068:0:5947:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787758959.985086:0:5947:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787758959.985089:0:5947:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787758959.985164:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995608064:12345-0@lo:256: Request processed in 111us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758959.985191:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787758959.985263:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995608064:0@lo:256: 10000000:01000000:1.0:1787758959.985303:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787758959.985310:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cf400/0x1a77009127f05122 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05129 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.985318:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cf400/0x1a77009127f05122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05129 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758959.985327:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787758959.985329:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787758959.985332:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787758959.985349:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.985357:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.985375:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758959.985388:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995608192:0@lo:101: 00000100:00100000:1.0:1787758959.985413:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758959.989134:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301a0c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758959.989576:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995608192 00000100:00100000:2.0:1787758959.989586:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995608192 00000100:00100000:2.0:1787758959.989641:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787758959.989650:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995608192:12345-0@lo:101: 00010000:00010000:2.0:1787758959.989666:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758959.989683:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c151e000/0x1a77009127f05137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f05130 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758959.989710:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c151e000/0x1a77009127f05137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f05130 expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758959.989722:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c151e000/0x1a77009127f05137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05130 expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758959.989729:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c151e000, rc 0) 00000100:00100000:2.0:1787758959.990066:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995608192:12345-0@lo:101: Request processed in 416us (4650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758959.990073:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787758959.990075:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995608192:0@lo:101: 00010000:00010000:1.0:1787758959.990092:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05137 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758959.990101:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f05137 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758959.990190:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995608320:0@lo:501: 00000100:00100000:1.0:1787758959.990222:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758959.990527:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995608320 00000100:00100000:0.0:1787758959.990533:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995608320 00000100:00100000:1.0:1787758959.990547:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301a0c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758959.991997:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787758959.992010:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995608320:12345-0@lo:501: 00000100:00100000:2.0:1787758959.992169:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995608320:12345-0@lo:501: Request processed in 162us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758959.992197:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787758959.992229:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995608320:0@lo:501: 00000100:00100000:1.0:1787758959.992268:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995608448:0@lo:503: 00000100:00100000:1.0:1787758959.992308:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758959.992344:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301a0c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758959.992348:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995608448 00000100:00100000:3.0:1787758959.992354:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995608448 00000100:00100000:3.0:1787758959.992427:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787758959.992434:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995608448:12345-0@lo:503: 00000100:00100000:3.0:1787758959.992520:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995608448:12345-0@lo:503: Request processed in 86us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758959.992526:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787758959.992583:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995608448:0@lo:503: 00000100:00100000:1.0:1787758959.993098:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8406:1874600995608576:0@lo:502: 00000100:00100000:1.0:1787758959.993136:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758959.993223:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301a0cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787758959.993307:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995608576 00000100:00100000:2.0:1787758959.993313:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995608576 00000100:00100000:2.0:1787758959.993384:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787758959.993393:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:8406:x1874600995608576:12345-0@lo:502: 00000100:00100000:2.0:1787758959.993490:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:8406:x1874600995608576:12345-0@lo:502: Request processed in 98us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758959.993497:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787758959.993559:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8406:1874600995608576:0@lo:502: 00000020:01000000:1.0:1787758959.993588:0:8406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787758959.993596:0:8406:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787758959.993603:0:8406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758959.993606:0:8406:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787758959.993614:0:8406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787758959.993618:0:8406:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.133@tcp to nid 0x20000c0a8cc85 (192.168.204.133@tcp) 00000020:01000000:1.0:1787758959.993653:0:8406:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787758959.993657:0:8406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787758959.993672:0:8406:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff88b2f547ced8) 00000020:00000080:1.0:1787758959.993693:0:8406:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787758959.993699:0:8406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787758959.993784:0:8406:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787758959.993789:0:8406:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787758959.993797:0:8406:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a77009127f05145 00010000:00080000:1.0:1787758959.993826:0:8406:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88b2fe218800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.133@tcp at head 00010000:00010000:1.0:1787758959.994090:0:8406:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1787758959.994227:0:8406:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787758959.994238:0:8406:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787758959.994394:0:8406:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787758959.994547:0:8406:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787758959.994679:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787758959.994771:0:8406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787758959.995347:0:8407:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787758959.995351:0:8407:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787758959.996465:0:8406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787758959.996477:0:8406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787758959.996520:0:8406:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787758959.996544:0:8406:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a77009127f0514c 00000100:00080000:1.0:1787758959.996554:0:8406:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787758959.996559:0:8406:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88b2fe218800 using connection 192.168.204.133@tcp/0@lo 00000100:00100000:1.0:1787758959.996598:0:8406:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b2e4aa83c0 x1874600995608704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787758959.996616:0:8406:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787758959.996781:0:8406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787758959.996785:0:8406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758959.996787:0:8406:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787758959.996791:0:8406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787758959.996794:0:8406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758959.996796:0:8406:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787758959.996799:0:8406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787758959.996800:0:8406:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787758959.996863:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8406:1874600995608832:0@lo:502: 00000100:00100000:1.0:1787758959.997207:0:8406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758959.997279:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2cf30d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787758959.997344:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3440:1874600995608704:0@lo:8: 00000100:00100000:2.0:1787758959.997381:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758959.997655:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995608704 00000100:00100000:1.0:1787758959.997662:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995608704 00000100:00100000:1.0:1787758959.997700:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787758959.997708:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3440:x1874600995608704:12345-0@lo:8: 00010000:00080000:1.0:1787758959.997734:0:6940:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:1.0:1787758959.997765:0:6940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a77009127f05153 00002000:00100000:1.0:1787758959.997780:0:6940:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff88b2fee2e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787758959.997784:0:6940:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787758959.997788:0:6940:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787758959.997882:0:6940:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787758959.998402:0:6940:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787758959.998432:0:6940:0:(import.c:65:import_set_state_nolock()) ffff88b2fee2f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787758959.998497:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3440:x1874600995608704:12345-0@lo:8: Request processed in 788us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758959.998517:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787758959.998612:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e4aa83c0 x1874600995608704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787758969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758959.998623:0:3440:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787758959.998640:0:3440:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787758959.998647:0:3440:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787758959.998652:0:3440:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787758959.998654:0:3440:0:(import.c:65:import_set_state_nolock()) ffff88b2fe218800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787758959.998673:0:3440:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787758959.998677:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3440:1874600995608704:0@lo:8: 00000004:00080000:1.0:1787758959.998790:0:8407:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787758959.998871:0:8407:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 203268030281ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787758959.998878:0:8407:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787758959.999311:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995608832 00000100:00100000:3.0:1787758959.999318:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995608832 00000100:00100000:3.0:1787758959.999361:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787758959.999369:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:8406:x1874600995608832:12345-0@lo:502: 00000100:00100000:3.0:1787758959.999490:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:8406:x1874600995608832:12345-0@lo:502: Request processed in 122us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758959.999497:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787758959.999714:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3442:1874600995609088:0@lo:400: 00000100:00100000:0.0:1787758959.999750:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758959.999776:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787758959.999782:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3442:1874600995608960:0@lo:400: 00000100:00100000:0.0:1787758959.999804:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758959.999828:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3443:1874600995609216:0@lo:400: 00000100:00100000:0.0:1787758959.999887:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758960.000159:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995609088 00000100:00100000:0.0:1787758960.000164:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995609088 00000100:00100000:0.0:1787758960.000222:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995608960 00000100:00100000:0.0:1787758960.000225:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995608960 00000100:00100000:0.0:1787758960.000239:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995609216 00000100:00100000:0.0:1787758960.000242:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995609216 00000100:00100000:0.0:1787758960.000257:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787758960.000263:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1874600995609088:12345-0@lo:400: 00000100:00100000:0.0:1787758960.000304:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1874600995609088:12345-0@lo:400: Request processed in 41us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758960.000310:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787758960.000322:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787758960.000328:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1874600995608960:12345-0@lo:400: 00000100:00100000:0.0:1787758960.000353:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1874600995608960:12345-0@lo:400: Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758960.000358:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787758960.000369:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787758960.000385:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1874600995609216:12345-0@lo:400: 00000100:00100000:0.0:1787758960.000418:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1874600995609216:12345-0@lo:400: Request processed in 35us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758960.000425:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787758960.000460:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe6cbc00 x1874600995608960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758960.000472:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3442:1874600995608960:0@lo:400: 00010000:00080000:0.0:1787758960.000484:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe6c8b40 x1874600995609088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758960.000492:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3442:1874600995609088:0@lo:400: 00010000:00080000:0.0:1787758960.000520:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe6cb0c0 x1874600995609216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758960.000528:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3443:1874600995609216:0@lo:400: 00000100:00080000:2.0:1787758960.000585:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787758960.004133:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8406:1874600995608832:0@lo:502: 00000020:01000000:0.0:1787758960.004191:0:8406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758960.004202:0:8406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758960.004205:0:8406:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787758960.004210:0:8406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1787758960.004441:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787758960.004462:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787758960.004474:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05137 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758960.004486:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05137 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758960.004497:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787758960.004499:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88b300e3ced8 from 1 10000000:01000000:3.0:1787758960.004502:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787758960.004536:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758960.004543:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758960.004564:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758960.004583:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995609344:0@lo:101: 00000100:00100000:3.0:1787758960.004657:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758960.004703:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758960.004818:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995609344 00000100:00100000:0.0:1787758960.004824:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995609344 00000100:00100000:0.0:1787758960.004892:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787758960.004902:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995609344:12345-0@lo:101: 00010000:00010000:0.0:1787758960.004915:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758960.004946:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e472b800/0x1a77009127f05161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f0515a expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758960.004979:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e472b800/0x1a77009127f05161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f0515a expref: 19 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758960.004988:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e472b800/0x1a77009127f05161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f0515a expref: 19 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758960.004997:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e472b800, rc 0) 00000100:00100000:0.0:1787758960.005034:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995609344:12345-0@lo:101: Request processed in 134us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758960.005041:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787758960.005069:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a03c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995609344:0@lo:101: 00010000:00010000:0.0:1787758960.005082:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05161 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758960.005090:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f05161 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758960.005140:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995609472:0@lo:501: 00000100:00100000:0.0:1787758960.005164:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758960.005194:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3480 going to sleep for 11 seconds 00000100:00100000:0.0:1787758960.005209:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995609472 00000100:00100000:0.0:1787758960.005213:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995609472 00000100:00100000:0.0:1787758960.005232:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787758960.005238:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995609472:12345-0@lo:501: 00000100:00100000:0.0:1787758960.005306:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995609472:12345-0@lo:501: Request processed in 68us (140us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787758960.005313:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787758960.005350:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995609472:0@lo:501: 10000000:01000000:0.0:1787758960.005370:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787758960.005377:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05161 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758960.005384:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05161 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787758960.013680:0:5931:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787758960.013858:0:8408:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787758960.013889:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6ae1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8408:1874600995609728:0@lo:7: 00000100:00100000:1.0:1787758960.013896:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787758960.013911:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995609600:0@lo:13: 00000100:00100000:1.0:1787758960.013974:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758960.014072:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995609600 00000100:00100000:3.0:1787758960.014080:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995609600 00000100:00100000:3.0:1787758960.014198:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787758960.014209:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aa9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1874600995609600:12345-0@lo:13: 00002000:00000024:3.0:1787758960.014236:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1787758960.014286:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aa9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1874600995609600:12345-0@lo:13: Request processed in 80us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758960.014293:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787758960.014306:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe6ae580 x1874600995609600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758960.014326:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995609600:0@lo:13: 00000100:00100000:2.0:1787758960.014395:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758960.014418:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2fed44cc0 going to sleep for 11 seconds 00000100:00080000:1.0:1787758960.014706:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787758960.014912:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995609728 00000100:00100000:3.0:1787758960.014918:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995609728 00000100:00100000:3.0:1787758960.014958:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787758960.014967:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8408:x1874600995609728:12345-0@lo:7: 00002000:00080000:2.0:1787758960.019612:0:7432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787758960.019622:0:7432:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787758960.019810:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8408:x1874600995609728:12345-0@lo:7: Request processed in 4840us (5411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758960.019827:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787758960.020144:0:8408:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe6ae1c0 x1874600995609728/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787758976 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758960.020160:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6ae1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8408:1874600995609728:0@lo:7: 00000004:00080000:3.0:1787758960.020186:0:8408:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787758960.020532:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8408:1874600995609856:0@lo:5: 00000100:00100000:0.0:1787758960.020576:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758960.020604:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787758960.020647:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995609856 00000100:00100000:2.0:1787758960.020655:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995609856 00000100:00100000:2.0:1787758960.020739:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787758960.020749:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8408:x1874600995609856:12345-0@lo:5: 00002000:00080000:2.0:1787758960.020774:0:6941:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787758960.020778:0:6941:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1787758960.026351:0:8011:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787758960.026365:0:8011:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787758960.027090:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758960.027152:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8408:x1874600995609856:12345-0@lo:5: Request processed in 6400us (6571us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787758960.027164:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787758960.027215:0:8408:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e36ec000 x1874600995609856/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787758976 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758960.027228:0:8408:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787758960.027235:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8408:1874600995609856:0@lo:5: 00000004:00080000:0.0:1787758960.027250:0:8408:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787758960.027295:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8408:1874600995609984:0@lo:700: 00000100:00100000:0.0:1787758960.027328:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758960.027367:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787758960.027375:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995609984 00000100:00100000:2.0:1787758960.027381:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995609984 00000100:00100000:2.0:1787758960.027425:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787758960.027434:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8408:x1874600995609984:12345-0@lo:700: 00000100:00100000:2.0:1787758960.027468:0:6948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6af840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6948:1874600995610112:0@lo:700: 00000100:00100000:2.0:1787758960.027496:0:6948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758960.027524:0:6948:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2fed44000 going to sleep for 11 seconds 00000100:00100000:1.0:1787758960.027593:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995610112 00000100:00100000:1.0:1787758960.027598:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995610112 00000100:00100000:1.0:1787758960.027641:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787758960.027649:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6948:x1874600995610112:12345-0@lo:700: 40000000:02000000:1.0:1787758960.039425:0:5960:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787758960.051960:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6948:x1874600995610112:12345-0@lo:700: Request processed in 24302us (24453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758960.051975:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787758960.053068:0:6948:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe6af840 x1874600995610112/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787758976 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758960.053099:0:6948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6af840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6948:1874600995610112:0@lo:700: 40000000:02000000:0.0:1787758960.053115:0:6948:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1787758960.082163:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8408:x1874600995609984:12345-0@lo:700: Request processed in 54720us (54823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758960.082190:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787758960.082289:0:8408:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e36ec000 x1874600995609984/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787758976 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758960.082306:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8408:1874600995609984:0@lo:700: 00000004:02000040:0.0:1787758960.102040:0:8408:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787758960.113135:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8408:1874600995610240:0@lo:5: 00000100:00100000:0.0:1787758960.113220:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758960.113327:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787758960.116208:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995610240 00000100:00100000:1.0:1787758960.116220:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995610240 00000100:00100000:1.0:1787758960.116353:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787758960.116364:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8408:x1874600995610240:12345-0@lo:5: 00002000:00080000:1.0:1787758960.125292:0:6942:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787758960.125312:0:6942:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787758960.127951:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8408:x1874600995610240:12345-0@lo:5: Request processed in 11583us (14724us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787758960.127975:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787758960.127997:0:8408:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e36ec000 x1874600995610240/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787758976 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758960.128016:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8408:1874600995610240:0@lo:5: 00000004:00080000:0.0:1787758960.128034:0:8408:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000020:00000004:2.0:1787758960.209471:0:8428:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787758960.210059:0:8428:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787758961.051883:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787758961.373200:0:8011:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787758962.074332:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758963.099598:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787758963.482430:0:8530:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787758963.482831:0:8530:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787758964.124260:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787758964.493725:0:8578:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787758964.493736:0:8578:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1787758965.014536:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758965.014626:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972517504 00000100:00100000:0.0:1787758965.014636:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972517504 00000100:00100000:0.0:1787758965.014682:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 113 00000100:00100000:0.0:1787758965.014691:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2361:x1874600972517504:12345-192.168.204.33@tcp:250: 00010000:00080000:0.0:1787758965.014720:0:5948:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 3c9fe673-2cdb-44ef-bded-a7cbd520bfb9@192.168.204.33@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:0.0:1787758965.014774:0:5948:0:(genops.c:1385:class_connect()) connect: client 3c9fe673-2cdb-44ef-bded-a7cbd520bfb9, cookie 0x1a77009127f05168 00000100:00080000:0.0:1787758965.014939:0:5948:0:(import.c:65:import_set_state_nolock()) ffff88b2fec18000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787758965.015042:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+5:2361:x1874600972517504:12345-192.168.204.33@tcp:250: Request processed in 340us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758965.015050:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 113 00000100:00100000:2.0:1787758965.030878:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787758965.031583:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972517632 00000100:00100000:3.0:1787758965.031626:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972517632 00000100:00100000:3.0:1787758965.031921:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 114 00000100:00100000:3.0:1787758965.031935:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+5:5444:x1874600972517632:12345-192.168.204.33@tcp:101: 00010000:00010000:3.0:1787758965.031961:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758965.031985:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e350ce00/0x1a77009127f0516f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd1a7b4edcc53346b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758965.032022:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e350ce00/0x1a77009127f0516f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc53346b expref: 6 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758965.032035:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e350ce00/0x1a77009127f0516f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc53346b expref: 6 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758965.032046:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e350ce00, rc 0) 00000100:00100000:3.0:1787758965.032155:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+6:5444:x1874600972517632:12345-192.168.204.33@tcp:101: Request processed in 223us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758965.032162:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 114 00000100:00100000:3.0:1787758965.035179:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758965.035310:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972517760 00000100:00100000:2.0:1787758965.035323:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972517760 00000100:00100000:2.0:1787758965.035427:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 115 00000100:00100000:2.0:1787758965.035439:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+6:5444:x1874600972517760:12345-192.168.204.33@tcp:501: 00000100:00100000:2.0:1787758965.036060:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+6:5444:x1874600972517760:12345-192.168.204.33@tcp:501: Request processed in 620us (893us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787758965.036071:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 115 00000100:00100000:1.0:1787758965.047122:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758965.047291:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972517888 00000100:00100000:0.0:1787758965.047303:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972517888 00000100:00100000:0.0:1787758965.047377:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 116 00000100:00100000:0.0:1787758965.047389:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+6:5444:x1874600972517888:12345-192.168.204.33@tcp:101: 00010000:00010000:0.0:1787758965.047413:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758965.047437:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e472a200/0x1a77009127f05176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd1a7b4edcc533472 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758965.047475:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e472a200/0x1a77009127f05176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc533472 expref: 7 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758965.047490:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e472a200/0x1a77009127f05176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc533472 expref: 7 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758965.047500:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e472a200, rc 0) 00000100:00100000:0.0:1787758965.047583:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+7:5444:x1874600972517888:12345-192.168.204.33@tcp:101: Request processed in 196us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758965.047590:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 116 00000100:00100000:0.0:1787758965.050044:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758965.050215:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972518016 00000100:00100000:2.0:1787758965.050228:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972518016 00000100:00100000:2.0:1787758965.050328:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 117 00000100:00100000:2.0:1787758965.050340:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+7:5444:x1874600972518016:12345-192.168.204.33@tcp:501: 00000100:00100000:2.0:1787758965.050582:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+8:5444:x1874600972518016:12345-192.168.204.33@tcp:501: Request processed in 243us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758965.050591:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 117 00000100:00100000:3.0:1787758965.052410:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758965.053042:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972518144 00000100:00100000:0.0:1787758965.053057:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972518144 00000100:00100000:0.0:1787758965.053161:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 118 00000100:00100000:0.0:1787758965.053173:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+8:5444:x1874600972518144:12345-192.168.204.33@tcp:503: 00000100:00100000:0.0:1787758965.053364:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+8:5444:x1874600972518144:12345-192.168.204.33@tcp:503: Request processed in 192us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758965.053382:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 118 00000100:00100000:3.0:1787758965.055717:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758965.056250:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972518272 00000100:00100000:0.0:1787758965.056263:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972518272 00000100:00100000:0.0:1787758965.056323:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 119 00000100:00100000:0.0:1787758965.056334:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+8:5462:x1874600972518272:12345-192.168.204.33@tcp:502: 00000100:00100000:0.0:1787758965.056550:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+8:5462:x1874600972518272:12345-192.168.204.33@tcp:502: Request processed in 216us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758965.056559:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 119 00000100:00100000:3.0:1787758965.082591:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758965.082783:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787758965.082811:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995610368:0@lo:13: 00000100:00100000:1.0:1787758965.082899:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758965.082983:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995610368 00000100:00100000:1.0:1787758965.082992:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995610368 00000100:00100000:1.0:1787758965.083060:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787758965.083070:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aa8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995610368:12345-0@lo:13: 00002000:00000024:1.0:1787758965.083124:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787758965.083176:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aa8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995610368:12345-0@lo:13: Request processed in 107us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758965.083184:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787758965.083211:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787758965.083248:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e4aab840 x1874600995610368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758965.083271:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995610368:0@lo:13: 00000100:00100000:1.0:1787758965.083334:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995610496:0@lo:13: 00000100:00100000:1.0:1787758965.083359:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758965.083389:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995610496 00000100:00100000:1.0:1787758965.083393:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995610496 00000100:00100000:1.0:1787758965.083421:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787758965.083428:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995610496:12345-0@lo:13: 00002000:00000024:1.0:1787758965.083445:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787758965.083476:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995610496:12345-0@lo:13: Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758965.083499:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787758965.083514:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787758965.083531:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e4aab840 x1874600995610496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758965.083540:0:3442:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787758965.083555:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995610496:0@lo:13: 00000100:00100000:0.0:1787758965.083724:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972518400 00000100:00100000:0.0:1787758965.083729:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972518400 00000100:00100000:0.0:1787758965.083772:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 120 00000100:00100000:0.0:1787758965.083780:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+8:5462:x1874600972518400:12345-192.168.204.33@tcp:502: 00000100:00100000:0.0:1787758965.083954:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+8:5462:x1874600972518400:12345-192.168.204.33@tcp:502: Request processed in 175us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758965.083963:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 120 00000100:00100000:0.0:1787758965.085011:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995610624:0@lo:400: 00000100:00100000:0.0:1787758965.085092:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758965.085211:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995610624 00000100:00100000:1.0:1787758965.085218:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995610624 00000100:00100000:1.0:1787758965.085261:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787758965.085269:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3443:x1874600995610624:12345-0@lo:400: 00000100:00100000:2.0:1787758965.085344:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3444:1874600995610752:0@lo:400: 00000100:00100000:2.0:1787758965.085380:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758965.085417:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995610752 00000100:00100000:2.0:1787758965.085421:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995610752 00000100:00100000:2.0:1787758965.085456:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787758965.085462:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1874600995610752:12345-0@lo:400: 00000100:00100000:2.0:1787758965.085500:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1874600995610752:12345-0@lo:400: Request processed in 38us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758965.085508:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1787758965.085564:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e3a03480 x1874600995610752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758965.085579:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3444:1874600995610752:0@lo:400: 00000100:00100000:1.0:1787758965.085930:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3443:x1874600995610624:12345-0@lo:400: Request processed in 659us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758965.085939:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787758965.086220:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3441:1874600995610880:0@lo:400: 00000100:00100000:2.0:1787758965.086272:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758965.086332:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995610880 00000100:00100000:1.0:1787758965.086338:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995610880 00000100:00100000:1.0:1787758965.086384:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787758965.086391:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1874600995610880:12345-0@lo:400: 00000100:00100000:1.0:1787758965.086494:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1874600995610880:12345-0@lo:400: Request processed in 103us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758965.086501:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787758965.086520:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787758965.086531:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e3a021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3442:1874600995611008:0@lo:400: 00000100:00100000:0.0:1787758965.086639:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995610624:0@lo:400: 00000100:00100000:1.0:1787758965.086794:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758965.086871:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995611008 00000100:00100000:0.0:1787758965.086875:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995611008 00000100:00100000:0.0:1787758965.086917:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787758965.086924:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1874600995611008:12345-0@lo:400: 00000100:00100000:0.0:1787758965.086965:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1874600995611008:12345-0@lo:400: Request processed in 41us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758965.086971:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787758965.087011:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e3a021c0 x1874600995611008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758965.087024:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3442:1874600995611008:0@lo:400: 00000100:00080000:1.0:1787758965.087095:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787758965.087266:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e3a03480 x1874600995610880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758965.087276:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e3a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3441:1874600995610880:0@lo:400: 00000100:00100000:3.0:1787758965.088815:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758965.089221:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972518528 00000100:00100000:1.0:1787758965.089233:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972518528 00000100:00100000:1.0:1787758965.089322:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 122 00000100:00100000:1.0:1787758965.089333:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+8:5444:x1874600972518528:12345-192.168.204.33@tcp:101: 00010000:00010000:1.0:1787758965.089357:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758965.089381:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0517d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd1a7b4edcc53349c expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758965.089417:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0517d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc53349c expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758965.089430:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2fe4cfa00/0x1a77009127f0517d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc53349c expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758965.089440:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2fe4cfa00, rc 0) 00000100:00100000:1.0:1787758965.089518:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5444:x1874600972518528:12345-192.168.204.33@tcp:101: Request processed in 187us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758965.089526:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 122 00000100:00100000:0.0:1787758965.095242:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758965.095345:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972518656 00000100:00100000:2.0:1787758965.095358:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972518656 00000100:00100000:2.0:1787758965.095479:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 123 00000100:00100000:2.0:1787758965.095492:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5444:x1874600972518656:12345-192.168.204.33@tcp:256: 20000000:01000000:2.0:1787758965.095530:0:5948:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787758965.095560:0:5948:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787758965.095565:0:5948:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787758965.095568:0:5948:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787758965.095570:0:5948:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787758965.097344:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5444:x1874600972518656:12345-192.168.204.33@tcp:256: Request processed in 1839us (2103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758965.097361:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 123 00000100:00100000:3.0:1787758965.099958:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758965.100243:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972518784 00000100:00100000:1.0:1787758965.100255:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972518784 00000100:00100000:1.0:1787758965.100329:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 124 00000100:00100000:1.0:1787758965.100341:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5444:x1874600972518784:12345-192.168.204.33@tcp:101: 00010000:00010000:1.0:1787758965.100364:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758965.100386:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f05184 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd1a7b4edcc5334a3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758965.100422:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f05184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334a3 expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758965.100434:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f05184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334a3 expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758965.100468:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2fe4ce800, rc 0) 00000100:00100000:1.0:1787758965.100547:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5444:x1874600972518784:12345-192.168.204.33@tcp:101: Request processed in 208us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758965.100555:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 124 00000100:00100000:3.0:1787758965.104212:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758965.104330:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972518912 00000100:00100000:2.0:1787758965.104347:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972518912 00000100:00100000:2.0:1787758965.104435:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 125 00000100:00100000:2.0:1787758965.104446:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5444:x1874600972518912:12345-192.168.204.33@tcp:501: 00000100:00100000:2.0:1787758965.104634:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5444:x1874600972518912:12345-192.168.204.33@tcp:501: Request processed in 189us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758965.104643:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 125 00000100:00100000:0.0:1787758965.106657:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758965.106779:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972519040 00000100:00100000:2.0:1787758965.106791:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972519040 00000100:00100000:2.0:1787758965.106899:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 126 00000100:00100000:2.0:1787758965.106911:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5444:x1874600972519040:12345-192.168.204.33@tcp:503: 00000100:00100000:2.0:1787758965.107251:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5444:x1874600972519040:12345-192.168.204.33@tcp:503: Request processed in 341us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758965.107261:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 126 00000100:00100000:3.0:1787758965.112236:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758965.112588:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972519168 00000100:00100000:1.0:1787758965.112602:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972519168 00000100:00100000:1.0:1787758965.112732:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 127 00000100:00100000:1.0:1787758965.112744:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5466:x1874600972519168:12345-192.168.204.33@tcp:502: 00000100:00100000:1.0:1787758965.113275:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5466:x1874600972519168:12345-192.168.204.33@tcp:502: Request processed in 531us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758965.113285:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 127 00000100:00100000:3.0:1787758965.115946:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758965.117060:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972519296 00000100:00100000:2.0:1787758965.117087:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972519296 00000100:00100000:2.0:1787758965.117160:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 128 00000100:00100000:2.0:1787758965.117170:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5466:x1874600972519296:12345-192.168.204.33@tcp:502: 00000100:00100000:2.0:1787758965.117398:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5466:x1874600972519296:12345-192.168.204.33@tcp:502: Request processed in 228us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758965.117407:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 128 00000100:00100000:3.0:1787758965.122042:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758965.122297:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972519424 00000100:00100000:2.0:1787758965.122310:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972519424 00000100:00100000:2.0:1787758965.122454:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 4 00000100:00100000:2.0:1787758965.122466:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2361:x1874600972519424:12345-192.168.204.33@tcp:38: 00010000:00080000:2.0:1787758965.122511:0:5954:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 2fdb7338-6109-4f60-9752-fc8ea99264a4@192.168.204.33@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1787758965.122652:0:5954:0:(genops.c:1385:class_connect()) connect: client 2fdb7338-6109-4f60-9752-fc8ea99264a4, cookie 0x1a77009127f0518b 00000004:00100000:2.0:1787758965.122689:0:5954:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787758965.122756:0:5954:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787758965.133943:0:5954:0:(import.c:65:import_set_state_nolock()) ffff88b2e0e17800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787758965.134084:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2361:x1874600972519424:12345-192.168.204.33@tcp:38: Request processed in 11608us (12046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758965.134099:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 4 00010000:00010000:0.0:1787758965.151394:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758966.148303:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758966.148475:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972519552 00000100:00100000:2.0:1787758966.148490:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972519552 00000100:00100000:2.0:1787758966.148606:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00100000:2.0:1787758966.148620:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:0:x1874600972519552:12345-192.168.204.33@tcp:41: 00000004:00000024:2.0:1787758966.148696:0:8028:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1787758966.148786:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:0:x1874600972519552:12345-192.168.204.33@tcp:41: Request processed in 168us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758966.148796:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 5 00000100:00080000:1.0:1787758966.148880:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787758966.149935:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758966.150046:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972519680 00000100:00100000:1.0:1787758966.150069:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972519680 00000100:00100000:1.0:1787758966.150128:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00100000:1.0:1787758966.150138:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:5444:x1874600972519680:12345-192.168.204.33@tcp:41: 00000004:00000024:1.0:1787758966.150171:0:5955:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1787758966.150247:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:5444:x1874600972519680:12345-192.168.204.33@tcp:41: Request processed in 110us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758966.150254:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 6 00000100:00100000:3.0:1787758966.152689:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758966.152882:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972519808 00000100:00100000:2.0:1787758966.152896:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972519808 00000100:00100000:2.0:1787758966.152964:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:2.0:1787758966.152974:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:5444:x1874600972519808:12345-192.168.204.33@tcp:40: 00000100:00100000:2.0:1787758966.153107:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:5444:x1874600972519808:12345-192.168.204.33@tcp:40: Request processed in 133us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758966.153115:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:3.0:1787758966.156892:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787758966.156952:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787758966.157019:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787758966.157079:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758966.157727:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972520192 00000100:00100000:1.0:1787758966.157741:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972520192 00000100:00100000:1.0:1787758966.157811:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:1.0:1787758966.157824:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:5444:x1874600972520192:12345-192.168.204.33@tcp:33: 00000100:00100000:2.0:1787758966.158113:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972519936 00000100:00100000:2.0:1787758966.158118:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972519936 00000100:00100000:2.0:1787758966.158152:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972520064 00000100:00100000:2.0:1787758966.158155:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972520064 00000100:00100000:2.0:1787758966.158173:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:2.0:1787758966.158180:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874600972519936:12345-192.168.204.33@tcp:8: 00010000:00080000:2.0:1787758966.158223:0:6941:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 2fdb7338-6109-4f60-9752-fc8ea99264a4@192.168.204.33@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:2.0:1787758966.158263:0:6941:0:(genops.c:1385:class_connect()) connect: client 2fdb7338-6109-4f60-9752-fc8ea99264a4, cookie 0x1a77009127f05192 00002000:00100000:2.0:1787758966.158277:0:6941:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2fdb7338-6109-4f60-9752-fc8ea99264a4/ffff88b2e0e14000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787758966.158292:0:6941:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787758966.158721:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:0.0:1787758966.158729:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1874600972520064:12345-192.168.204.33@tcp:8: 00010000:00080000:0.0:1787758966.158747:0:6940:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 2fdb7338-6109-4f60-9752-fc8ea99264a4@192.168.204.33@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1787758966.158769:0:6940:0:(genops.c:1385:class_connect()) connect: client 2fdb7338-6109-4f60-9752-fc8ea99264a4, cookie 0x1a77009127f05199 00002000:00100000:0.0:1787758966.158774:0:6940:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2fdb7338-6109-4f60-9752-fc8ea99264a4/ffff88b2fec1b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787758966.158781:0:6940:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787758966.160826:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972520320 00000100:00100000:1.0:1787758966.160888:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972520320 00000100:00100000:1.0:1787758966.160962:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 129 00000100:00100000:1.0:1787758966.160972:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972520320:12345-192.168.204.33@tcp:400: 00000100:00100000:1.0:1787758966.161086:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972520320:12345-192.168.204.33@tcp:400: Request processed in 115us (4133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758966.161094:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 129 00002000:00080000:2.0:1787758966.161363:0:6941:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787758966.161411:0:6941:0:(import.c:65:import_set_state_nolock()) ffff88b2e0e17000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787758966.161447:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2361:x1874600972519936:12345-192.168.204.33@tcp:8: Request processed in 3267us (4428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758966.161457:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 8 00002000:00080000:0.0:1787758966.166501:0:6940:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787758966.167185:0:6940:0:(import.c:65:import_set_state_nolock()) ffff88b2fec18800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787758966.167613:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2361:x1874600972520064:12345-192.168.204.33@tcp:8: Request processed in 8873us (10523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758966.167629:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 9 00010000:00010000:1.0:1787758966.170124:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787758966.187967:0:5956:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 29994us 00000004:00200000:0.0:1787758966.207932:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787758966.208125:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:5444:x1874600972520192:12345-192.168.204.33@tcp:33: Request processed in 50296us (51244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758966.208145:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:1.0:1787758966.517694:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787758966.517791:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972520448 00000100:00100000:3.0:1787758966.517801:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972520448 00000100:00100000:3.0:1787758966.517892:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:3.0:1787758966.517903:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:5483:x1874600972520448:12345-192.168.204.33@tcp:101: 00010000:00010000:3.0:1787758966.517924:0:5955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758966.517995:0:5955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b2e350de00/0x1a77009127f051a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1a7b4edcc5334cd expref: -99 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.518091:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2e350da00/0x1a77009127f051a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.518107:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b2e350da00/0x1a77009127f051a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.518133:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b2e350da00/0x1a77009127f051a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787758966.518182:0:5955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787758966.518186:0:5955:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787758966.518205:0:5955:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b2e350da00/0x1a77009127f051a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.518353:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b2e350de00/0x1a77009127f051a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334cd expref: 8 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.518393:0:5955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2e350da00/0x1a77009127f051a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334cd expref: 7 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.518402:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b2d6ae8700) 00010000:00010000:3.0:1787758966.518405:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787758966.518409:0:5955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e350da00, rc 0) 00000100:00100000:3.0:1787758966.518478:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+7:5483:x1874600972520448:12345-192.168.204.33@tcp:101: Request processed in 576us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758966.518485:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 8 00010000:00010000:2.0:1787758967.193997:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758968.219177:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758968.685099:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758968.685233:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972520576 00000100:00100000:0.0:1787758968.685242:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972520576 00000100:00100000:0.0:1787758968.685320:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00100000:0.0:1787758968.685331:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fdb7338-6109-4f60-9752-fc8ea99264a4+7:5535:x1874600972520576:12345-192.168.204.33@tcp:41: 00000004:00000024:0.0:1787758968.685383:0:8028:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:0.0:1787758968.685453:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fdb7338-6109-4f60-9752-fc8ea99264a4+7:5535:x1874600972520576:12345-192.168.204.33@tcp:41: Request processed in 124us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758968.685460:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 9 00000100:00080000:1.0:1787758968.688240:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787758968.692085:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758968.692198:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972520704 00000100:00100000:2.0:1787758968.692210:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972520704 00000100:00100000:2.0:1787758968.692300:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:2.0:1787758968.692312:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe66bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:5535:x1874600972520704:12345-192.168.204.33@tcp:13: 00002000:00000024:2.0:1787758968.692351:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1787758968.692437:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe66bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:5535:x1874600972520704:12345-192.168.204.33@tcp:13: Request processed in 126us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758968.692445:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00080000:1.0:1787758968.693156:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787758968.697571:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758968.697742:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972520832 00000100:00100000:1.0:1787758968.697760:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972520832 00000100:00100000:1.0:1787758968.697876:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:1.0:1787758968.697889:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:5535:x1874600972520832:12345-192.168.204.33@tcp:13: 00002000:00000024:1.0:1787758968.697927:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787758968.698003:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:5535:x1874600972520832:12345-192.168.204.33@tcp:13: Request processed in 118us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758968.698023:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00080000:2.0:1787758968.698760:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787758969.242069:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758970.202685:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3444:1874600995611264:0@lo:400: 00000100:00100000:3.0:1787758970.202685:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3441:1874600995611392:0@lo:400: 00000100:00100000:1.0:1787758970.202760:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995611136:0@lo:400: 00000100:00100000:2.0:1787758970.204614:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758970.204634:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995611520:0@lo:400: 00000100:00100000:3.0:1787758970.204678:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758970.204698:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995611776:0@lo:400: 00000100:00100000:2.0:1787758970.204731:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758970.204777:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995611264 00000100:00100000:0.0:1787758970.204787:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995611264 00000100:00100000:0.0:1787758970.204883:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787758970.204895:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1874600995611264:12345-0@lo:400: 00000100:00100000:0.0:1787758970.204963:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1874600995611264:12345-0@lo:400: Request processed in 70us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758970.204972:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787758970.205040:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995611520 00000100:00100000:3.0:1787758970.205045:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995611520 00000100:00100000:3.0:1787758970.205117:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995611776 00000100:00100000:3.0:1787758970.205120:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995611776 00000100:00080000:0.0:1787758970.205148:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787758970.205152:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787758970.205166:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787758970.205174:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995611520:12345-0@lo:400: 00000100:00100000:0.0:1787758970.205209:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995611520:12345-0@lo:400: Request processed in 36us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758970.205214:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787758970.205366:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787758970.205372:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995611776:12345-0@lo:400: 00000100:00100000:3.0:1787758970.205404:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995611776:12345-0@lo:400: Request processed in 33us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758970.205410:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787758970.205448:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2febec780 x1874600995611520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758970.205461:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995611520:0@lo:400: 00000100:00100000:3.0:1787758970.205757:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758970.205810:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995611392 00000100:00100000:3.0:1787758970.205814:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995611392 00000100:00100000:3.0:1787758970.205864:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787758970.205871:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1874600995611392:12345-0@lo:400: 00000100:00100000:3.0:1787758970.205909:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1874600995611392:12345-0@lo:400: Request processed in 39us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758970.205920:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787758970.205953:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3441:1874600995611392:0@lo:400: 00000100:00100000:3.0:1787758970.205997:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3444:1874600995611264:0@lo:400: 00010000:00080000:3.0:1787758970.206008:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2febeed00 x1874600995611776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758970.206017:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995611776:0@lo:400: 00000100:00100000:1.0:1787758970.208293:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758970.208362:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3443:1874600995611648:0@lo:400: 00000100:00100000:1.0:1787758970.208401:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758970.208492:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787758970.208510:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995611904:0@lo:13: 00000100:00100000:1.0:1787758970.208541:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758970.208570:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995611904 00000100:00100000:1.0:1787758970.208577:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995611904 00000100:00100000:1.0:1787758970.208634:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787758970.208644:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe669e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995611904:12345-0@lo:13: 00002000:00000024:1.0:1787758970.208675:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787758970.208724:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe669e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995611904:12345-0@lo:13: Request processed in 82us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758970.208732:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787758970.208787:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe66a1c0 x1874600995611904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758970.208805:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995611904:0@lo:13: 00000100:00100000:1.0:1787758970.208887:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995611648 00000100:00100000:1.0:1787758970.208892:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995611648 00000100:00100000:1.0:1787758970.208929:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787758970.208936:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe66a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1874600995611648:12345-0@lo:400: 00000100:00100000:1.0:1787758970.208993:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe66a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1874600995611648:12345-0@lo:400: Request processed in 56us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758970.209001:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787758970.209020:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787758970.209042:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3443:1874600995611648:0@lo:400: 00000100:00100000:0.0:1787758970.212093:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995611136 00000100:00100000:0.0:1787758970.212108:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995611136 00000100:00100000:0.0:1787758970.212162:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787758970.212171:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3443:x1874600995611136:12345-0@lo:400: 00000100:00100000:0.0:1787758970.213454:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3443:x1874600995611136:12345-0@lo:400: Request processed in 1277us (5158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758970.213469:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787758970.213535:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787758970.213556:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995612032:0@lo:13: 00000100:00100000:0.0:1787758970.213560:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995611136:0@lo:400: 00000100:00100000:2.0:1787758970.213620:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758970.213726:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995612032 00000100:00100000:0.0:1787758970.213732:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995612032 00000100:00100000:0.0:1787758970.214619:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787758970.214632:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995612032:12345-0@lo:13: 00002000:00000024:0.0:1787758970.214663:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1787758970.214727:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995612032:12345-0@lo:13: Request processed in 98us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758970.214734:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787758970.214836:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe6ac000 x1874600995612032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758970.214903:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995612032:0@lo:13: 00010000:00010000:2.0:1787758970.267507:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787758970.715763:0:8011:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2fdb7338-6109-4f60-9752-fc8ea99264a4 00000001:00100000:0.0:1787758970.717731:0:5931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2fdb7338-6109-4f60-9752-fc8ea99264a4 00010000:00010000:0.0:1787758971.290096:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758971.562406:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758971.562656:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972520960 00000100:00100000:1.0:1787758971.562669:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972520960 00000100:00100000:1.0:1787758971.562749:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 131 00000100:00100000:1.0:1787758971.562761:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2363:x1874600972520960:12345-192.168.204.33@tcp:400: 00000100:00100000:1.0:1787758971.562934:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2363:x1874600972520960:12345-192.168.204.33@tcp:400: Request processed in 175us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758971.562944:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 131 00000100:00100000:0.0:1787758971.569707:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758971.569766:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758971.569785:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972521088 00000100:00100000:1.0:1787758971.569798:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972521088 00000100:00100000:0.0:1787758971.569799:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758971.569826:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972521344 00000100:00100000:0.0:1787758971.569830:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972521344 00000100:00100000:0.0:1787758971.569895:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972521216 00000100:00100000:0.0:1787758971.569899:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972521216 00000100:00100000:1.0:1787758971.569901:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 26 00000100:00100000:1.0:1787758971.569912:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2362:x1874600972521088:12345-192.168.204.33@tcp:400: 00000100:00100000:0.0:1787758971.569921:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:0.0:1787758971.569927:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2362:x1874600972521344:12345-192.168.204.33@tcp:400: 00000100:00100000:0.0:1787758971.570234:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2362:x1874600972521344:12345-192.168.204.33@tcp:400: Request processed in 306us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758971.570244:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 7 00000100:00100000:0.0:1787758971.570266:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00100000:0.0:1787758971.570273:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2362:x1874600972521216:12345-192.168.204.33@tcp:400: 00000100:00100000:1.0:1787758971.572295:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2362:x1874600972521088:12345-192.168.204.33@tcp:400: Request processed in 2366us (2585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758971.572299:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2362:x1874600972521216:12345-192.168.204.33@tcp:400: Request processed in 2022us (2494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758971.572323:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 26 00000100:00100000:0.0:1787758971.572331:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 8 00000100:00080000:1.0:1787758971.572382:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787758971.572388:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787758971.572393:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1787758971.747652:0:6935:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2fdb7338-6109-4f60-9752-fc8ea99264a4 00000001:02000400:0.0:1787758971.958506:0:8676:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787758972.316650:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758973.338430:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758974.362398:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758975.322149:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3441:1874600995612416:0@lo:400: 00000100:00100000:1.0:1787758975.322223:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758975.322283:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787758975.322290:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe668780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995612544:0@lo:400: 00000100:00100000:1.0:1787758975.322317:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758975.322366:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995612416 00000100:00100000:1.0:1787758975.322373:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995612416 00000100:00100000:1.0:1787758975.322429:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787758975.322439:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe668b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1874600995612416:12345-0@lo:400: 00000100:00100000:1.0:1787758975.322489:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe668b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1874600995612416:12345-0@lo:400: Request processed in 53us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.322497:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787758975.322520:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995612544 00000100:00100000:1.0:1787758975.322531:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995612544 00000100:00100000:1.0:1787758975.322562:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787758975.322574:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe668f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995612544:12345-0@lo:400: 00000100:00100000:1.0:1787758975.322608:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe668f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995612544:12345-0@lo:400: Request processed in 35us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.322614:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787758975.322636:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787758975.322640:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787758975.322669:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe668780 x1874600995612544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758975.322683:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe668780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995612544:0@lo:400: 00000100:00100000:1.0:1787758975.322695:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3441:1874600995612416:0@lo:400: 00000100:00100000:3.0:1787758975.322817:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995612160:0@lo:400: 00000100:00100000:3.0:1787758975.322895:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758975.322926:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe669a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3443:1874600995612672:0@lo:400: 00000100:00100000:3.0:1787758975.322956:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758975.322979:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787758975.322986:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995612288:0@lo:400: 00000100:00100000:3.0:1787758975.323008:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758975.323027:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995612800:0@lo:400: 00000100:00100000:3.0:1787758975.323053:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758975.323085:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995612672 00000100:00100000:3.0:1787758975.323089:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995612672 00000100:00100000:3.0:1787758975.323135:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995612288 00000100:00100000:3.0:1787758975.323139:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995612288 00000100:00100000:3.0:1787758975.323163:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787758975.323169:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1874600995612672:12345-0@lo:400: 00000100:00100000:3.0:1787758975.323213:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1874600995612672:12345-0@lo:400: Request processed in 43us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758975.323219:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787758975.323235:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787758975.323243:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995612288:12345-0@lo:400: 00000100:00100000:3.0:1787758975.323271:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995612288:12345-0@lo:400: Request processed in 30us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758975.323277:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787758975.323298:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995612800 00000100:00100000:3.0:1787758975.323302:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995612800 00000100:00100000:3.0:1787758975.323326:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787758975.323333:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995612800:12345-0@lo:400: 00000100:00100000:3.0:1787758975.323362:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995612800:12345-0@lo:400: Request processed in 30us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758975.323368:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787758975.323380:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787758975.323383:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787758975.323408:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995612288:0@lo:400: 00010000:00080000:3.0:1787758975.323419:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe66ad00 x1874600995612800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758975.323427:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995612800:0@lo:400: 00000100:00100000:3.0:1787758975.323435:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe669a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3443:1874600995612672:0@lo:400: 00000100:00100000:1.0:1787758975.326382:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995612160 00000100:00100000:1.0:1787758975.326397:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995612160 00000100:00100000:1.0:1787758975.326563:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787758975.326575:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3443:x1874600995612160:12345-0@lo:400: 00000100:00100000:1.0:1787758975.326682:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3443:x1874600995612160:12345-0@lo:400: Request processed in 110us (3787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.326690:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787758975.326733:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995612928:0@lo:13: 00000100:00100000:1.0:1787758975.326782:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758975.326816:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787758975.326823:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995613056:0@lo:13: 00000100:00100000:1.0:1787758975.326869:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758975.326920:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995612928 00000100:00100000:1.0:1787758975.326925:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995612928 00000100:00100000:1.0:1787758975.326947:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995613056 00000100:00100000:1.0:1787758975.326959:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995613056 00000100:00100000:1.0:1787758975.326975:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787758975.326982:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995612928:12345-0@lo:13: 00002000:00000024:1.0:1787758975.327007:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787758975.327048:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995612928:12345-0@lo:13: Request processed in 66us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.327064:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787758975.327076:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787758975.327081:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe668780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995613056:12345-0@lo:13: 00002000:00000024:1.0:1787758975.327095:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787758975.327121:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe668780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995613056:12345-0@lo:13: Request processed in 40us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.327127:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787758975.327163:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2febef480 x1874600995613056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758975.327182:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995613056:0@lo:13: 00010000:00080000:1.0:1787758975.327194:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe6ae1c0 x1874600995612928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758975.327204:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995612928:0@lo:13: 00000100:00100000:0.0:1787758975.329464:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995612160:0@lo:400: 00010000:00010000:1.0:1787758975.387005:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787758975.951323:0:8823:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfe6f53f0 20000000:00000080:2.0:1787758975.951347:0:8823:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88b2fe76cc00 uarg=0000000000000000 20000000:01000000:2.0:1787758975.951488:0:8823:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787758975.951490:0:8823:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787758975.951493:0:8823:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787758975.951498:0:8823:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787758975.951504:0:8823:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787758975.951569:0:8823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787758975.951572:0:8823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787758975.952141:0:8824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787758975.952505:0:8823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787758975.952540:0:8823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787758975.952557:0:8823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1787758975.952568:0:8823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787758975.952570:0:8823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787758975.953001:0:8825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787758975.953152:0:8823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787758975.953171:0:8823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787758975.953185:0:8823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1787758975.953193:0:8823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787758975.953195:0:8823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787758975.953507:0:8826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787758975.953652:0:8823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787758975.953745:0:8823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1787758975.953762:0:8823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1787758975.953772:0:8823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787758975.953774:0:8823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787758975.954224:0:8827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787758975.954378:0:8823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787758975.954398:0:8823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787758975.954484:0:8823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:2.0:1787758975.954501:0:8823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787758975.954521:0:8823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.954538:0:8823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2e350c400/0x1a77009127f050ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f050a4 expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.954546:0:8823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2c151ec00/0x1a77009127f050d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f050ce expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.954560:0:8823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2fe4ce600/0x1a77009127f050ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f050f8 expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.954566:0:8823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2e350cc00/0x1a77009127f0510d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05106 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.954573:0:8823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2e472a600/0x1a77009127f0511b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05114 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.954578:0:8823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2c151e000/0x1a77009127f05137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05130 expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.954584:0:8823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2e472b800/0x1a77009127f05161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f0515a expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.954593:0:8823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2e350ce00/0x1a77009127f0516f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc53346b expref: 9 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.954599:0:8823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2e472a200/0x1a77009127f05176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc533472 expref: 9 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.954606:0:8823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.954648:0:8823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2e472a200/0x1a77009127f05176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc533472 expref: 9 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.954731:0:8823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b2e472a200/0x1a77009127f05176 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc533472 expref: 9 pid: 5948 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758975.954758:0:8823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6ae580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995613184:192.168.204.33@tcp:104: 00010000:00010000:2.0:1787758975.955205:0:8823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2e350ce00/0x1a77009127f0516f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc53346b expref: 9 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.955214:0:8823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b2e350ce00/0x1a77009127f0516f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc53346b expref: 9 pid: 5946 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758975.955224:0:8823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6afc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995613312:192.168.204.33@tcp:104: 00010000:00010000:2.0:1787758975.955259:0:8823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2e472b800/0x1a77009127f05161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f0515a expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.955268:0:8823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2e472b800/0x1a77009127f05161 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f0515a expref: 18 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758975.955278:0:8823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6ad2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995613440:0@lo:104: 00000100:00100000:2.0:1787758975.955321:0:8823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787758975.955354:0:8823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2c151e000/0x1a77009127f05137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f05130 expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.955362:0:8823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2c151e000/0x1a77009127f05137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f05130 expref: 18 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758975.955371:0:8823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6af840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995613568:0@lo:104: 00000100:00100000:2.0:1787758975.955392:0:8823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758975.955503:0:5936:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787758975.955516:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995613440 00000100:00100000:0.0:1787758975.955522:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995613440 00000100:00100000:0.0:1787758975.955559:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995613568 00000100:00100000:0.0:1787758975.955561:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995613568 00000100:00100000:0.0:1787758975.955575:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787758975.955585:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+4:8823:x1874600995613440:12345-0@lo:104: 00010000:00010000:0.0:1787758975.955599:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f05161 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.955655:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787758975.955672:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+4:8823:x1874600995613440:12345-0@lo:104: Request processed in 78us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758975.955680:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787758975.955698:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787758975.955705:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2d6a98850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:8823:x1874600995613568:12345-0@lo:104: 00010000:00010000:0.0:1787758975.955712:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f05137 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.955743:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787758975.955755:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2d6a98850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:8823:x1874600995613568:12345-0@lo:104: Request processed in 51us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758975.955762:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1787758975.955799:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787758975.955805:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f05161 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.955814:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2e350c600 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:0.0:1787758975.955818:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f05161 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.955827:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f05161 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758975.955835:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f05161 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758975.955875:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787758975.955910:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05161 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.955918:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758975.955941:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05161 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.955948:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2e350c600/0x1a77009127f0515a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05161 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.955960:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787758975.955964:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f05137 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.955979:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2fe4cea00 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:0.0:1787758975.955981:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f05137 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.955989:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f05137 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758975.955995:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f05137 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758975.956001:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787758975.956014:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05137 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.956020:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758975.956025:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05137 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.956031:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cea00/0x1a77009127f05130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05137 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.956039:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758975.956042:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758975.956044:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758975.956051:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758975.956065:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995613696:0@lo:103: 00000100:00100000:0.0:1787758975.956094:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758975.956119:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787758975.956124:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995613824:0@lo:103: 00000100:00100000:0.0:1787758975.956150:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787758975.956341:0:8823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2e472a600/0x1a77009127f0511b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f05114 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.956352:0:8823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2e472a600/0x1a77009127f0511b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f05114 expref: 18 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758975.956368:0:8823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6ac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995613952:0@lo:104: 00000100:00100000:2.0:1787758975.956391:0:8823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787758975.956499:0:8823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2e350cc00/0x1a77009127f0510d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f05106 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.956508:0:8823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2e350cc00/0x1a77009127f0510d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f05106 expref: 18 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758975.956518:0:8823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995614080:0@lo:104: 00000100:00100000:2.0:1787758975.956541:0:8823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787758975.956557:0:8823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2fe4ce600/0x1a77009127f050ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f050f8 expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.956565:0:8823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2fe4ce600/0x1a77009127f050ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f050f8 expref: 18 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758975.956573:0:8823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995614208:0@lo:104: 00000100:00100000:2.0:1787758975.956591:0:8823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787758975.956605:0:8823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2c151ec00/0x1a77009127f050d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f050ce expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.956613:0:8823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2c151ec00/0x1a77009127f050d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f050ce expref: 18 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758975.956621:0:8823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f30c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995614336:0@lo:104: 00000100:00100000:1.0:1787758975.957052:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995613952 00000100:00100000:1.0:1787758975.957060:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995613952 00000100:00100000:1.0:1787758975.957086:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995614080 00000100:00100000:1.0:1787758975.957089:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995614080 00000100:00100000:1.0:1787758975.957099:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995614208 00000100:00100000:1.0:1787758975.957101:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995614208 00000100:00100000:1.0:1787758975.957111:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787758975.957126:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+5:8823:x1874600995613952:12345-0@lo:104: 00010000:00010000:1.0:1787758975.957137:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f0511b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.957186:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787758975.957191:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+5:8823:x1874600995613952:12345-0@lo:104: Request processed in 68us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.957198:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787758975.957213:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787758975.957219:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+4:8823:x1874600995614080:12345-0@lo:104: 00010000:00010000:1.0:1787758975.957227:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f0510d expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.957258:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787758975.957262:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+4:8823:x1874600995614080:12345-0@lo:104: Request processed in 44us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.957268:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787758975.957280:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787758975.957285:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:8823:x1874600995614208:12345-0@lo:104: 00010000:00010000:1.0:1787758975.957291:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f050ff expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.957333:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787758975.957338:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:8823:x1874600995614208:12345-0@lo:104: Request processed in 54us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.957344:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787758975.957364:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995613696 00000100:00100000:1.0:1787758975.957374:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995613696 00010000:00010000:1.0:1787758975.957391:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2e472b800/0x1a77009127f05161 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f0515a expref: 19 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758975.957421:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995613824 00000100:00100000:1.0:1787758975.957425:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995613824 00010000:00010000:1.0:1787758975.957434:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2c151e000/0x1a77009127f05137 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05130 expref: 20 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758975.957447:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787758975.957453:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aa8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+20:3443:x1874600995613696:12345-0@lo:103: 00010000:00010000:1.0:1787758975.957463:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758975.957468:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2e472b800/0x1a77009127f05161 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f0515a expref: 20 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.957478:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2e472b800/0x1a77009127f05161 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f0515a expref: 20 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.957495:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787758975.957525:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aa8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+20:3443:x1874600995613696:12345-0@lo:103: Request processed in 72us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.957536:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787758975.957548:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787758975.957554:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aaad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3443:x1874600995613824:12345-0@lo:103: 00010000:00010000:1.0:1787758975.957562:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758975.957565:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2c151e000/0x1a77009127f05137 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05130 expref: 19 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.957572:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2c151e000/0x1a77009127f05137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f05130 expref: 19 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.957591:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787758975.957614:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aaad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3443:x1874600995613824:12345-0@lo:103: Request processed in 61us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.957620:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1787758975.957636:0:6955:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787758975.957642:0:6955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f0511b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.957649:0:6955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2fe4cfe00 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:1.0:1787758975.957653:0:6955:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f0511b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758975.957830:0:8823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787758975.957893:0:8823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2e350c400/0x1a77009127f050ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f050a4 expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758975.957914:0:8823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2e350c400/0x1a77009127f050ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f050a4 expref: 18 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758975.957923:0:8823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995614464:0@lo:104: 00000100:00100000:2.0:1787758975.957947:0:8823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758975.957958:0:8823:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c52e3d80 going to sleep for 11 seconds 00010000:00010000:2.0:1787758975.957981:0:8823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2e472b800/0x1a77009127f05161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f0515a expref: 18 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758975.957995:0:8823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6ad2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995613440:0@lo:104: 00010000:00010000:2.0:1787758975.958007:0:8823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c151e000/0x1a77009127f05137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f05130 expref: 17 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758975.958013:0:8823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6af840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995613568:0@lo:104: 00000100:00100000:2.0:1787758975.958021:0:8823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6ac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995613952:0@lo:104: 00000100:00100000:2.0:1787758975.958027:0:8823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995614080:0@lo:104: 00000100:00100000:2.0:1787758975.958034:0:8823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995614208:0@lo:104: 00010000:00010000:1.0:1787758975.958092:0:6955:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f0511b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787758975.958101:0:6955:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f0511b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758975.958106:0:6955:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787758975.958139:0:6955:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0511b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.958145:0:6955:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787758975.958160:0:6955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0511b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.958167:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f05114 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0511b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.958187:0:6955:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787758975.958190:0:6955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f0510d expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.958196:0:6955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c151e200 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:1.0:1787758975.958199:0:6955:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f0510d expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.958205:0:6955:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f0510d expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787758975.958212:0:6955:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f0510d expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758975.958217:0:6955:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787758975.958231:0:6955:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0510d expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.958237:0:6955:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787758975.958242:0:6955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0510d expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.958248:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0510d expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.958257:0:6955:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787758975.958259:0:6955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f050ff expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.958276:0:6955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c151f200 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:1.0:1787758975.958279:0:6955:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f050ff expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.958286:0:6955:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f050ff expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787758975.958292:0:6955:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f050ff expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758975.958297:0:6955:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787758975.958308:0:6955:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f050ff expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.958313:0:6955:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787758975.958318:0:6955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f050ff expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.958323:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c151f200/0x1a77009127f050f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f050ff expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.958331:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758975.958333:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758975.958334:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758975.958349:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995614592:0@lo:103: 00000100:00100000:1.0:1787758975.958374:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758975.958392:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787758975.958397:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995614720:0@lo:103: 00000100:00100000:0.0:1787758975.958589:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995614336 00000100:00100000:0.0:1787758975.958595:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995614336 00000100:00100000:0.0:1787758975.958616:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995614464 00000100:00100000:0.0:1787758975.958618:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995614464 00000100:00100000:0.0:1787758975.958629:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787758975.958635:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+4:8823:x1874600995614336:12345-0@lo:104: 00010000:00010000:0.0:1787758975.958643:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f050d5 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.958691:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787758975.958696:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+4:8823:x1874600995614336:12345-0@lo:104: Request processed in 62us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758975.958702:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787758975.958714:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787758975.958720:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:8823:x1874600995614464:12345-0@lo:104: 00010000:00010000:0.0:1787758975.958726:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f050ab expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.958747:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787758975.958751:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:8823:x1874600995614464:12345-0@lo:104: Request processed in 32us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758975.958756:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787758975.958899:0:8823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f30c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995614336:0@lo:104: 00000100:00100000:2.0:1787758975.958906:0:8823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995614464:0@lo:104: 00000100:00100000:1.0:1787758975.959096:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787758975.959136:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787758975.959142:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f050d5 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.959149:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2e350d600 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:1.0:1787758975.959152:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f050d5 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.959160:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f050d5 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787758975.959167:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f050d5 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758975.959172:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787758975.959190:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f050d5 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.959195:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787758975.959200:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f050d5 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.959207:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f050ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f050d5 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.959217:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787758975.959220:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f050ab expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.959225:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2e472b000 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:1.0:1787758975.959234:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f050ab expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.959241:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f050ab expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787758975.959247:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f050ab expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758975.959252:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787758975.959262:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f050ab expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.959267:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787758975.959275:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f050ab expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.959281:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2e472b000/0x1a77009127f050a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f050ab expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.959293:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758975.959294:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758975.959296:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758975.959300:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787758975.959308:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995615104:0@lo:103: 00000100:00100000:1.0:1787758975.959330:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758975.959348:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995614848:0@lo:103: 00000100:00100000:1.0:1787758975.959365:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758975.959379:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995613824:0@lo:103: 00000100:00100000:1.0:1787758975.959387:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995613696:0@lo:103: 00000100:00100000:1.0:1787758975.959406:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787758975.959634:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995614976:0@lo:103: 00000100:00100000:1.0:1787758975.959717:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787758975.959736:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758975.959746:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995614592 00000100:00100000:1.0:1787758975.959750:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995614592 00010000:00010000:1.0:1787758975.959769:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2e472a600/0x1a77009127f0511b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05114 expref: 17 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758975.959784:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995614720 00000100:00100000:1.0:1787758975.959786:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995614720 00010000:00010000:1.0:1787758975.959795:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2e350cc00/0x1a77009127f0510d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05106 expref: 18 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758975.959803:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995615104 00000100:00100000:1.0:1787758975.959805:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995615104 00010000:00010000:1.0:1787758975.959813:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2e350c400/0x1a77009127f050ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f050a4 expref: 19 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758975.959821:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995614848 00000100:00100000:1.0:1787758975.959823:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995614848 00010000:00010000:1.0:1787758975.959831:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2fe4ce600/0x1a77009127f050ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f050f8 expref: 20 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.959891:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758975.959928:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995614976 00000100:00100000:1.0:1787758975.959932:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995614976 00010000:00010000:1.0:1787758975.959944:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2c151ec00/0x1a77009127f050d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f050ce expref: 21 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758975.959956:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787758975.959961:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe66b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+21:3441:x1874600995614592:12345-0@lo:103: 00010000:00010000:1.0:1787758975.959978:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758975.959982:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2e472a600/0x1a77009127f0511b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05114 expref: 21 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.959993:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2e472a600/0x1a77009127f0511b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f05114 expref: 21 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.960006:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2e472a600/0x1a77009127f0511b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f05114 expref: 21 pid: 5946 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.960018:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787758975.960041:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe66b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+20:3441:x1874600995614592:12345-0@lo:103: Request processed in 80us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.960048:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787758975.960060:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787758975.960065:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe669a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995614720:12345-0@lo:103: 00010000:00010000:1.0:1787758975.960071:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758975.960076:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2e350cc00/0x1a77009127f0510d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05106 expref: 19 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.960084:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2e350cc00/0x1a77009127f0510d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f05106 expref: 19 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.960093:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2e350cc00/0x1a77009127f0510d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f05106 expref: 19 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.960102:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787758975.960117:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe669a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:3441:x1874600995614720:12345-0@lo:103: Request processed in 53us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.960130:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787758975.960140:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787758975.960145:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe66b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:3442:x1874600995615104:12345-0@lo:103: 00010000:00010000:1.0:1787758975.960151:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758975.960155:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2e350c400/0x1a77009127f050ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f050a4 expref: 17 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.960163:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2e350c400/0x1a77009127f050ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f050a4 expref: 17 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.960172:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2e350c400/0x1a77009127f050ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f050a4 expref: 17 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.960180:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787758975.960241:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe66b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:3442:x1874600995615104:12345-0@lo:103: Request processed in 95us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.960247:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787758975.960257:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787758975.960263:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe66a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:3443:x1874600995614848:12345-0@lo:103: 00010000:00010000:1.0:1787758975.960269:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758975.960273:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2fe4ce600/0x1a77009127f050ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f050f8 expref: 15 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.960281:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2fe4ce600/0x1a77009127f050ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f050f8 expref: 15 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.960290:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2fe4ce600/0x1a77009127f050ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f050f8 expref: 15 pid: 5948 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.960307:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787758975.960332:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe66a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:3443:x1874600995614848:12345-0@lo:103: Request processed in 70us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.960338:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787758975.960349:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787758975.960354:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7275050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:3443:x1874600995614976:12345-0@lo:103: 00010000:00010000:1.0:1787758975.960360:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758975.960364:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2c151ec00/0x1a77009127f050d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f050ce expref: 13 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.960371:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2c151ec00/0x1a77009127f050d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f050ce expref: 13 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.960381:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c151ec00/0x1a77009127f050d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f050ce expref: 13 pid: 5947 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.960389:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787758975.960404:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7275050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:3443:x1874600995614976:12345-0@lo:103: Request processed in 51us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.960409:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787758975.960517:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995614976:0@lo:103: 00000100:00100000:1.0:1787758975.960525:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995614848:0@lo:103: 00000100:00100000:1.0:1787758975.960541:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995614720:0@lo:103: 00000100:00100000:1.0:1787758975.960548:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995614592:0@lo:103: 00000100:00100000:0.0:1787758975.961062:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995615104:0@lo:103: 00000100:00100000:1.0:1787758975.965565:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787758975.965610:0:8823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6ae580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995613184:192.168.204.33@tcp:104: 00000100:00100000:1.0:1787758975.965619:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787758975.965641:0:8823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6afc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8823:1874600995613312:192.168.204.33@tcp:104: 00000100:00100000:1.0:1787758975.965650:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972521472 00000100:00100000:1.0:1787758975.965657:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972521472 00010000:00010000:3.0:1787758975.965700:0:8823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758975.965782:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972521600 00000100:00100000:0.0:1787758975.965786:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972521600 00010000:00010000:0.0:1787758975.965822:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2e350ce00/0x1a77009127f0516f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc53346b expref: 10 pid: 5946 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758975.965891:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:0.0:1787758975.965902:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe66b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2363:x1874600972521600:12345-192.168.204.33@tcp:103: 00010000:00010000:0.0:1787758975.965917:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758975.965922:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2e350ce00/0x1a77009127f0516f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc53346b expref: 10 pid: 5946 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.965932:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2e350ce00/0x1a77009127f0516f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc53346b expref: 10 pid: 5946 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.965950:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2e350ce00/0x1a77009127f0516f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc53346b expref: 10 pid: 5946 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758975.965966:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787758975.966014:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe66b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:2363:x1874600972521600:12345-192.168.204.33@tcp:103: Request processed in 114us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758975.966020:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 19 00010000:00010000:1.0:1787758975.966263:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2e472a200/0x1a77009127f05176 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc533472 expref: 9 pid: 5948 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758975.966293:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 20 00000100:00100000:1.0:1787758975.966301:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe66a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:2363:x1874600972521472:12345-192.168.204.33@tcp:103: 00010000:00010000:1.0:1787758975.966309:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758975.966313:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2e472a200/0x1a77009127f05176 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc533472 expref: 9 pid: 5948 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.966323:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2e472a200/0x1a77009127f05176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc533472 expref: 9 pid: 5948 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.966335:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2e472a200/0x1a77009127f05176 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc533472 expref: 9 pid: 5948 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.966347:0:5940:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.966356:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.966372:0:5940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.966380:0:5940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.966387:0:5940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.966400:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.966407:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c151fc00 already unused, calling callback (ffffffffc0e68530) 00010000:00010000:1.0:1787758975.966421:0:5940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.966431:0:5940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.966450:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758975.966461:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787758975.966471:0:8823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758975.966482:0:8823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758975.966489:0:8823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c151fc00/0x1a77009127f051ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758975.966603:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe66a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+8:2363:x1874600972521472:12345-192.168.204.33@tcp:103: Request processed in 302us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758975.966611:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 20 00010000:00010000:1.0:1787758976.410874:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758976.672695:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758976.672754:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758976.672790:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758976.672827:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758976.672915:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972521984 00000100:00100000:1.0:1787758976.672925:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972521984 00000100:00100000:1.0:1787758976.672981:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972522112 00000100:00100000:1.0:1787758976.672985:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972522112 00000100:00100000:1.0:1787758976.673007:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:1.0:1787758976.673018:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2365:x1874600972521984:12345-192.168.204.33@tcp:400: 00000100:00100000:0.0:1787758976.673151:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:0.0:1787758976.673162:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe66b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2365:x1874600972522112:12345-192.168.204.33@tcp:400: 00000100:00100000:0.0:1787758976.673256:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe66b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2365:x1874600972522112:12345-192.168.204.33@tcp:400: Request processed in 96us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758976.673264:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:0.0:1787758976.673402:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972521856 00000100:00100000:0.0:1787758976.673407:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972521856 00000100:00100000:0.0:1787758976.673443:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 30 00000100:00100000:0.0:1787758976.673450:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe66ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2365:x1874600972521856:12345-192.168.204.33@tcp:400: 00000100:00100000:0.0:1787758976.673498:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe66ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2365:x1874600972521856:12345-192.168.204.33@tcp:400: Request processed in 48us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758976.673505:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 30 00000100:00080000:0.0:1787758976.673569:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787758976.673574:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787758976.673576:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787758976.673781:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2365:x1874600972521984:12345-192.168.204.33@tcp:400: Request processed in 765us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758976.673788:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:2.0:1787758976.674186:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972521728 00000100:00100000:2.0:1787758976.674193:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972521728 00000100:00100000:2.0:1787758976.674231:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 133 00000100:00100000:2.0:1787758976.674239:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+8:2365:x1874600972521728:12345-192.168.204.33@tcp:400: 00000100:00100000:2.0:1787758976.674270:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+8:2365:x1874600972521728:12345-192.168.204.33@tcp:400: Request processed in 32us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758976.674286:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 133 10000000:01000000:0.0:1787758977.308159:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787758977.308167:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b2fe715800 from 39 10000000:01000000:0.0:1787758977.308172:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787758977.308226:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f051b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758977.308238:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f051b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758977.308249:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f051b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758977.308276:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995615232:0@lo:101: 00000100:00100000:0.0:1787758977.308348:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758977.308476:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b280c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.316465:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995615232 00000100:00100000:3.0:1787758977.316482:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995615232 00000100:00100000:3.0:1787758977.316571:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787758977.316582:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+12:5950:x1874600995615232:12345-0@lo:101: 00010000:00010000:3.0:1787758977.316598:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758977.316619:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e350de00/0x1a77009127f051bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f051b5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.316648:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e350de00/0x1a77009127f051bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f051b5 expref: 13 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.316660:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e350de00/0x1a77009127f051bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f051b5 expref: 13 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.316668:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e350de00, rc 0) 00000100:00100000:3.0:1787758977.316781:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:5950:x1874600995615232:12345-0@lo:101: Request processed in 201us (8433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.316788:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787758977.317037:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995615232:0@lo:101: 00010000:00010000:0.0:1787758977.317057:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f051b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051bc expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758977.317066:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f051b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f051bc expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758977.317146:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995615360:0@lo:501: 00000100:00100000:0.0:1787758977.317190:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758977.317233:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b280c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758977.318685:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995615360 00000100:00100000:1.0:1787758977.318697:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995615360 00000100:00100000:1.0:1787758977.318768:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787758977.318778:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:5950:x1874600995615360:12345-0@lo:501: 00000100:00100000:1.0:1787758977.318976:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:5950:x1874600995615360:12345-0@lo:501: Request processed in 199us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758977.318984:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787758977.319164:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995615360:0@lo:501: 00000100:00100000:0.0:1787758977.319207:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995615488:0@lo:503: 00000100:00100000:0.0:1787758977.319257:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758977.319291:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b280c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.319362:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995615488 00000100:00100000:3.0:1787758977.319367:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995615488 00000100:00100000:3.0:1787758977.319401:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787758977.319408:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:5950:x1874600995615488:12345-0@lo:503: 00000100:00100000:3.0:1787758977.319491:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:5950:x1874600995615488:12345-0@lo:503: Request processed in 83us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.319498:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787758977.319538:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995615488:0@lo:503: 00000100:00100000:3.0:1787758977.320995:0:8840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febec3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8840:1874600995615616:0@lo:502: 00000100:00100000:3.0:1787758977.321058:0:8840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758977.321095:0:8840:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c8ea4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787758977.321149:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995615616 00000100:00100000:1.0:1787758977.321155:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995615616 00000100:00100000:1.0:1787758977.321198:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787758977.321207:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:8840:x1874600995615616:12345-0@lo:502: 00000100:00100000:1.0:1787758977.321321:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:8840:x1874600995615616:12345-0@lo:502: Request processed in 114us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758977.321328:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787758977.321452:0:8840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febec3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8840:1874600995615616:0@lo:502: 00000100:00100000:3.0:1787758977.321492:0:8840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febec3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8840:1874600995615744:0@lo:502: 00000100:00100000:3.0:1787758977.321523:0:8840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758977.321546:0:8840:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c8ea4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787758977.321666:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995615744 00000100:00100000:1.0:1787758977.321671:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995615744 00000100:00100000:1.0:1787758977.321702:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787758977.321708:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:8840:x1874600995615744:12345-0@lo:502: 00000100:00100000:1.0:1787758977.321893:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:8840:x1874600995615744:12345-0@lo:502: Request processed in 185us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758977.321900:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787758977.321981:0:8840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febec3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8840:1874600995615744:0@lo:502: 00000040:00080000:0.0:1787758977.322002:0:8840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787758977.322200:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787758977.322227:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787758977.322243:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f051b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051bc expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.322253:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2e472a800/0x1a77009127f051b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051bc expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758977.322262:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787758977.322265:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787758977.322268:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787758977.322295:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f051c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.322302:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f051c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.322311:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f051c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758977.322324:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe669a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995615872:0@lo:101: 00000100:00100000:1.0:1787758977.322354:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758977.322416:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787758977.327068:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995615872 00000100:00100000:0.0:1787758977.327085:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995615872 00000100:00100000:0.0:1787758977.327161:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787758977.327171:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+13:5950:x1874600995615872:12345-0@lo:101: 00010000:00010000:0.0:1787758977.327188:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758977.327207:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e472b400/0x1a77009127f051ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f051c3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758977.327237:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e472b400/0x1a77009127f051ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f051c3 expref: 14 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758977.327249:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e472b400/0x1a77009127f051ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f051c3 expref: 14 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758977.327260:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e472b400, rc 0) 00000100:00100000:0.0:1787758977.327337:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995615872:12345-0@lo:101: Request processed in 167us (4981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758977.327344:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787758977.327405:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe669a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995615872:0@lo:101: 00010000:00010000:0.0:1787758977.327438:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f051c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051ca expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758977.327447:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f051c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f051ca expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758977.327525:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995616000:0@lo:501: 00000100:00100000:0.0:1787758977.329067:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758977.329114:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758977.329193:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995616000 00000100:00100000:1.0:1787758977.329201:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995616000 00000100:00100000:1.0:1787758977.329255:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787758977.329263:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995616000:12345-0@lo:501: 00000100:00100000:1.0:1787758977.329407:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995616000:12345-0@lo:501: Request processed in 144us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758977.329415:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787758977.329567:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995616000:0@lo:501: 00000100:00100000:0.0:1787758977.329608:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995616128:0@lo:503: 00000100:00100000:0.0:1787758977.329653:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758977.329674:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758977.329866:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995616128 00000100:00100000:1.0:1787758977.329870:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995616128 00000100:00100000:1.0:1787758977.329912:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787758977.329918:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995616128:12345-0@lo:503: 00000100:00100000:1.0:1787758977.330002:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995616128:12345-0@lo:503: Request processed in 83us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758977.330009:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787758977.330657:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995616128:0@lo:503: 00000100:00100000:0.0:1787758977.331488:0:8841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8841:1874600995616256:0@lo:502: 00000100:00100000:0.0:1787758977.331545:0:8841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758977.331890:0:8841:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b28a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.334033:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995616256 00000100:00100000:3.0:1787758977.334046:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995616256 00000100:00100000:3.0:1787758977.334101:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787758977.334110:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8841:x1874600995616256:12345-0@lo:502: 00000100:00100000:3.0:1787758977.334375:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8841:x1874600995616256:12345-0@lo:502: Request processed in 265us (2828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.334383:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787758977.336954:0:8841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8841:1874600995616256:0@lo:502: 00000020:01000000:0.0:1787758977.337004:0:8841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787758977.337016:0:8841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758977.337018:0:8841:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787758977.337025:0:8841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787758977.337065:0:8841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8841:1874600995616384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758977.337135:0:8841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758977.337182:0:8841:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b28a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.337305:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995616384 00000100:00100000:3.0:1787758977.337320:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995616384 00000100:00100000:3.0:1787758977.337373:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787758977.337382:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8841:x1874600995616384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758977.337497:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:8841:x1874600995616384:12345-0@lo:502:llog_process_th.0 Request processed in 116us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.337505:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787758977.337911:0:8841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8841:1874600995616384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787758977.337942:0:8841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758977.337947:0:8841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758977.337949:0:8841:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787758977.337952:0:8841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787758977.338118:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787758977.338146:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787758977.338156:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f051c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051ca expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.338168:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cfe00/0x1a77009127f051c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051ca expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758977.338179:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787758977.338181:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b301aae000 from 39 10000000:01000000:1.0:1787758977.338184:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787758977.338214:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4ce200/0x1a77009127f051d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.338222:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2fe4ce200/0x1a77009127f051d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.338231:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2fe4ce200/0x1a77009127f051d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758977.338247:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995616512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787758977.338285:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758977.338323:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.338434:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995616512 00000100:00100000:3.0:1787758977.338440:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995616512 00000100:00100000:3.0:1787758977.338480:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787758977.338488:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+14:5950:x1874600995616512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787758977.338499:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758977.338512:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e350d400/0x1a77009127f051d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f051d1 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.338533:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e350d400/0x1a77009127f051d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f051d1 expref: 15 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.338543:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e350d400/0x1a77009127f051d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f051d1 expref: 15 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.338673:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e350d400, rc 0) 00000100:00100000:3.0:1787758977.338716:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995616512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.338723:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787758977.338869:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995616512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787758977.338891:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2fe4ce200/0x1a77009127f051d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051d8 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.338902:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2fe4ce200/0x1a77009127f051d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f051d8 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758977.338956:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995616640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758977.338981:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758977.339007:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787758977.339067:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995616640 00000100:00100000:2.0:1787758977.339072:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995616640 00000100:00100000:2.0:1787758977.339106:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787758977.339113:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995616640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758977.339226:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995616640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758977.339233:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787758977.339456:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995616640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758977.339488:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995616768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787758977.339527:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758977.339629:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b28a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787758977.339674:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995616768 00000100:00100000:2.0:1787758977.339678:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995616768 00000100:00100000:2.0:1787758977.339709:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787758977.339715:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995616768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758977.339986:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995616768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758977.339993:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787758977.340069:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995616768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758977.340432:0:8842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f1a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8842:1874600995616896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758977.340469:0:8842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758977.340541:0:8842:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c627a780 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.345791:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995616896 00000100:00100000:3.0:1787758977.345807:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995616896 00000100:00100000:3.0:1787758977.346726:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787758977.346742:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:8842:x1874600995616896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758977.347064:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:8842:x1874600995616896:12345-0@lo:502:llog_process_th.0 Request processed in 327us (6594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.347073:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787758977.347175:0:8842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f1a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8842:1874600995616896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758977.347244:0:8842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8842:1874600995617024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758977.347300:0:8842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758977.347342:0:8842:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15180 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.347399:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995617024 00000100:00100000:3.0:1787758977.347405:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995617024 00000100:00100000:3.0:1787758977.347436:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787758977.347444:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:8842:x1874600995617024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758977.347708:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:8842:x1874600995617024:12345-0@lo:502:llog_process_th.0 Request processed in 262us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.347715:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787758977.348984:0:8842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8842:1874600995617024:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787758977.349025:0:8842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787758977.350109:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787758977.350142:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787758977.350152:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4ce200/0x1a77009127f051d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051d8 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.350165:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2fe4ce200/0x1a77009127f051d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051d8 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758977.350175:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787758977.350177:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787758977.350180:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787758977.350218:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cf600/0x1a77009127f051df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.350226:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cf600/0x1a77009127f051df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.350249:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cf600/0x1a77009127f051df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758977.350270:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995617152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787758977.350328:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758977.350376:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15000 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.350489:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995617152 00000100:00100000:3.0:1787758977.350495:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995617152 00000100:00100000:3.0:1787758977.350544:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787758977.350564:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+15:5950:x1874600995617152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787758977.350578:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758977.350591:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e350ca00/0x1a77009127f051e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f051df expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.350612:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e350ca00/0x1a77009127f051e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f051df expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.350624:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e350ca00/0x1a77009127f051e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f051df expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.350633:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e350ca00, rc 0) 00000100:00100000:3.0:1787758977.350679:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995617152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.350695:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787758977.350872:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995617152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787758977.350886:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cf600/0x1a77009127f051df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051e6 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758977.350896:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cf600/0x1a77009127f051df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f051e6 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758977.350957:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995617280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758977.350985:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758977.351013:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b28a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787758977.351065:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995617280 00000100:00100000:1.0:1787758977.351070:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995617280 00000100:00100000:1.0:1787758977.351106:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787758977.351113:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995617280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758977.351238:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995617280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758977.351245:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787758977.351327:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995617280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758977.351360:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995617408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758977.351400:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758977.351420:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c627aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787758977.351466:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995617408 00000100:00100000:0.0:1787758977.351471:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995617408 00000100:00100000:0.0:1787758977.351491:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787758977.351497:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995617408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787758977.351604:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995617408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758977.351611:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787758977.351679:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995617408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758977.352130:0:8843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8843:1874600995617536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758977.352172:0:8843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758977.352203:0:8843:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c627ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787758977.352244:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995617536 00000100:00100000:0.0:1787758977.352249:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995617536 00000100:00100000:0.0:1787758977.352270:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787758977.352277:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:8843:x1874600995617536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758977.352355:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:8843:x1874600995617536:12345-0@lo:502:llog_process_th.0 Request processed in 77us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758977.352362:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787758977.352430:0:8843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8843:1874600995617536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787758977.352451:0:8843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787758977.352461:0:8843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758977.352463:0:8843:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787758977.352468:0:8843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787758977.352488:0:8843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8843:1874600995617664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758977.352520:0:8843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758977.352540:0:8843:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c627ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787758977.352812:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995617664 00000100:00100000:1.0:1787758977.352817:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995617664 00000100:00100000:1.0:1787758977.352873:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787758977.352881:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:8843:x1874600995617664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758977.352963:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:8843:x1874600995617664:12345-0@lo:502:llog_process_th.0 Request processed in 83us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758977.352970:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787758977.353060:0:8843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8843:1874600995617664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787758977.353078:0:8843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787758977.353083:0:8843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758977.353085:0:8843:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787758977.353088:0:8843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787758977.353367:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787758977.353389:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787758977.353398:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cf600/0x1a77009127f051df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051e6 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.353409:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cf600/0x1a77009127f051df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051e6 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758977.353428:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787758977.353430:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b2e05c4000 from 39 10000000:01000000:1.0:1787758977.353433:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787758977.353462:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4ce400/0x1a77009127f051ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.353469:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2fe4ce400/0x1a77009127f051ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.353477:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2fe4ce400/0x1a77009127f051ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758977.353491:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995617792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787758977.353520:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758977.353565:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15180 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.353665:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995617792 00000100:00100000:3.0:1787758977.353670:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995617792 00000100:00100000:3.0:1787758977.353707:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787758977.353713:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995617792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787758977.353722:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758977.353734:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e350c800/0x1a77009127f051f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f051ed expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.353755:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e350c800/0x1a77009127f051f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f051ed expref: 17 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.353765:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e350c800/0x1a77009127f051f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f051ed expref: 17 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.353774:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e350c800, rc 0) 00000100:00100000:3.0:1787758977.353810:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995617792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.353816:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787758977.354041:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995617792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787758977.354054:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2fe4ce400/0x1a77009127f051ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051f4 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.354062:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2fe4ce400/0x1a77009127f051ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f051f4 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758977.354111:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995617920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758977.354137:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758977.354165:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15180 going to sleep for 11 seconds 00000100:00100000:0.0:1787758977.354215:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995617920 00000100:00100000:0.0:1787758977.354220:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995617920 00000100:00100000:0.0:1787758977.354251:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787758977.354258:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995617920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758977.354373:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995617920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758977.354379:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787758977.354478:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995617920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758977.354506:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995618048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758977.354616:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758977.354638:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15180 going to sleep for 11 seconds 00000100:00100000:2.0:1787758977.354687:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995618048 00000100:00100000:2.0:1787758977.354691:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995618048 00000100:00100000:2.0:1787758977.354725:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787758977.354733:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995618048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758977.354814:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995618048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758977.354821:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787758977.354999:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995618048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758977.362445:0:8844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8844:1874600995618176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758977.362536:0:8844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758977.362694:0:8844:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c627af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.363727:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995618176 00000100:00100000:3.0:1787758977.363736:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995618176 00000100:00100000:3.0:1787758977.363795:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787758977.363806:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:8844:x1874600995618176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758977.364102:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:8844:x1874600995618176:12345-0@lo:502:llog_process_th.0 Request processed in 297us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.364111:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787758977.365774:0:8844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8844:1874600995618176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758977.366759:0:8844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8844:1874600995618304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758977.366871:0:8844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758977.366917:0:8844:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b283c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.367049:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995618304 00000100:00100000:3.0:1787758977.367063:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995618304 00000100:00100000:3.0:1787758977.367115:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787758977.367125:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:8844:x1874600995618304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758977.367247:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:8844:x1874600995618304:12345-0@lo:502:llog_process_th.0 Request processed in 124us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.367255:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787758977.367391:0:8844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8844:1874600995618304:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787758977.367418:0:8844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787758977.369755:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787758977.369803:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787758977.369815:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4ce400/0x1a77009127f051ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051f4 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.369828:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2fe4ce400/0x1a77009127f051ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f051f4 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758977.371302:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787758977.371310:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787758977.371315:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787758977.371372:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cee00/0x1a77009127f051fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.371382:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cee00/0x1a77009127f051fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.371393:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cee00/0x1a77009127f051fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758977.371424:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995618432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787758977.371495:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758977.371593:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15180 going to sleep for 11 seconds 00000100:00100000:2.0:1787758977.372683:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995618432 00000100:00100000:2.0:1787758977.372695:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995618432 00000100:00100000:2.0:1787758977.372820:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787758977.372830:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995618432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787758977.372873:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758977.372891:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c151e000/0x1a77009127f05202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f051fb expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758977.372917:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c151e000/0x1a77009127f05202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f051fb expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758977.372928:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c151e000/0x1a77009127f05202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f051fb expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758977.372937:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c151e000, rc 0) 00000100:00100000:2.0:1787758977.373001:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995618432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758977.373008:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787758977.373096:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995618432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787758977.373114:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cee00/0x1a77009127f051fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05202 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.373130:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cee00/0x1a77009127f051fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f05202 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758977.373202:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995618560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758977.373233:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758977.382451:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15180 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.382579:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995618560 00000100:00100000:3.0:1787758977.382589:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995618560 00000100:00100000:3.0:1787758977.382644:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787758977.382654:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995618560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787758977.382827:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995618560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (9593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.382834:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787758977.382962:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995618560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758977.383012:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995618688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758977.383068:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758977.383098:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15180 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.383153:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995618688 00000100:00100000:3.0:1787758977.383158:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995618688 00000100:00100000:3.0:1787758977.383178:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787758977.383184:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995618688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787758977.383410:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995618688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.383418:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787758977.384034:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995618688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758977.384384:0:8845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8845:1874600995618816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758977.384431:0:8845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758977.384507:0:8845:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d159c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.384712:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995618816 00000100:00100000:3.0:1787758977.384718:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995618816 00000100:00100000:3.0:1787758977.384791:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787758977.384800:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:8845:x1874600995618816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758977.384951:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:8845:x1874600995618816:12345-0@lo:502:llog_process_th.0 Request processed in 152us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.384968:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787758977.385049:0:8845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8845:1874600995618816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787758977.385072:0:8845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787758977.385081:0:8845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758977.385084:0:8845:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787758977.385090:0:8845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787758977.385112:0:8845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8845:1874600995618944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758977.385146:0:8845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758977.385396:0:8845:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c627aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787758977.385450:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995618944 00000100:00100000:0.0:1787758977.385461:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995618944 00000100:00100000:0.0:1787758977.385483:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787758977.385489:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:8845:x1874600995618944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758977.385580:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:8845:x1874600995618944:12345-0@lo:502:llog_process_th.0 Request processed in 90us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758977.385588:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787758977.387064:0:8845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8845:1874600995618944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787758977.387102:0:8845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787758977.387110:0:8845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758977.387113:0:8845:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787758977.387125:0:8845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787758977.387648:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787758977.387673:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787758977.387683:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cee00/0x1a77009127f051fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05202 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758977.387694:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2fe4cee00/0x1a77009127f051fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05202 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758977.387705:0:5950:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787758977.387707:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88b300e3ced8 from 1 10000000:01000000:0.0:1787758977.387710:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787758977.387742:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e472ba00/0x1a77009127f05209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758977.387749:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2e472ba00/0x1a77009127f05209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758977.387758:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2e472ba00/0x1a77009127f05209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758977.387778:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995619072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787758977.387833:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758977.387899:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b28d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.388105:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995619072 00000100:00100000:3.0:1787758977.388112:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995619072 00000100:00100000:3.0:1787758977.388157:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787758977.388166:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995619072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787758977.388179:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758977.388192:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e350c000/0x1a77009127f05210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f05209 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.388215:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e350c000/0x1a77009127f05210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f05209 expref: 19 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.388225:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e350c000/0x1a77009127f05210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05209 expref: 19 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.388233:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e350c000, rc 0) 00000100:00100000:3.0:1787758977.388316:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995619072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758977.388322:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787758977.391927:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995619072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787758977.391959:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2e472ba00/0x1a77009127f05209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05210 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758977.391973:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2e472ba00/0x1a77009127f05209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f05210 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758977.392066:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995619200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758977.392126:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758977.392213:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b301b28d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787758977.394812:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995619200 00000100:00100000:3.0:1787758977.394826:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995619200 00000100:00100000:0.0:1787758977.394984:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787758977.394995:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995619200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758977.395130:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995619200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (3003us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787758977.395138:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787758977.395665:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995619200:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787758977.395708:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787758977.395717:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e472ba00/0x1a77009127f05209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05210 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758977.395741:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2e472ba00/0x1a77009127f05209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05210 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758977.434042:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758978.458156:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758979.482133:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758980.442995:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995619712:0@lo:400:kworker.0 00000100:00100000:1.0:1787758980.443095:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758980.443160:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787758980.443166:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995619328:0@lo:400:kworker.0 00000100:00100000:1.0:1787758980.443194:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758980.443213:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3441:1874600995619840:0@lo:400:kworker.0 00000100:00100000:1.0:1787758980.443233:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758980.443263:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995619456:0@lo:400:kworker.0 00000100:00100000:1.0:1787758980.443283:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758980.443297:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995619968:0@lo:400:kworker.0 00000100:00100000:1.0:1787758980.443312:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758980.443324:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787758980.443328:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe669a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995619584:0@lo:400:kworker.0 00000100:00100000:1.0:1787758980.443343:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758980.443364:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995619840 00000100:00100000:1.0:1787758980.443370:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995619840 00000100:00100000:1.0:1787758980.443413:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995619456 00000100:00100000:1.0:1787758980.443415:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995619456 00000100:00100000:1.0:1787758980.443424:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995619584 00000100:00100000:1.0:1787758980.443426:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995619584 00000100:00100000:1.0:1787758980.443439:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787758980.443447:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1874600995619840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758980.443489:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1874600995619840:12345-0@lo:400:kworker.0 Request processed in 43us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758980.443496:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787758980.443510:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787758980.443515:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995619456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758980.443538:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995619456:12345-0@lo:400:kworker.0 Request processed in 23us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758980.443543:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787758980.443552:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787758980.443557:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995619584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758980.443576:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995619584:12345-0@lo:400:kworker.0 Request processed in 20us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758980.443592:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787758980.443872:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995620096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787758980.443905:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758980.443963:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995619328 00000100:00100000:2.0:1787758980.443967:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995619328 00000100:00100000:2.0:1787758980.444009:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787758980.444016:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995619328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758980.444047:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995619328:12345-0@lo:400:kworker.0 Request processed in 32us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758980.444053:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787758980.444099:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995619328:0@lo:400:kworker.0 00000100:00100000:2.0:1787758980.444112:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe669680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3441:1874600995619840:0@lo:400:kworker.0 00000100:00100000:0.0:1787758980.444817:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995619712 00000100:00100000:0.0:1787758980.444823:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995619712 00000100:00100000:0.0:1787758980.444892:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995619968 00000100:00100000:0.0:1787758980.444896:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995619968 00000100:00100000:0.0:1787758980.444918:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787758980.444925:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995619712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787758980.444971:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995619712:12345-0@lo:400:kworker.0 Request processed in 48us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758980.444976:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787758980.444989:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787758980.444994:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995619968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787758980.445032:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995619968:12345-0@lo:400:kworker.0 Request processed in 38us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758980.445037:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787758980.445058:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787758980.445061:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787758980.445063:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787758980.445088:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe6683c0 x1874600995619712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758980.445099:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995619712:0@lo:400:kworker.0 00000100:00100000:0.0:1787758980.445130:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995620096 00000100:00100000:0.0:1787758980.445134:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995620096 00000100:00100000:0.0:1787758980.445155:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787758980.445161:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995620096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787758980.445182:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1787758980.445217:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995620096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758980.445222:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787758980.445321:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe6f0b40 x1874600995620096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758980.445336:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995620096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787758980.446054:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe669a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995619584:0@lo:400:kworker.0 00000100:00100000:1.0:1787758980.446069:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995619456:0@lo:400:kworker.0 00010000:00080000:1.0:1787758980.446081:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe6cbc00 x1874600995619968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758980.446091:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995619968:0@lo:400:kworker.0 00000100:00100000:1.0:1787758980.447564:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787758980.447584:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995620224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787758980.447923:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758980.448216:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995620224 00000100:00100000:0.0:1787758980.448224:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995620224 00000100:00100000:0.0:1787758980.448319:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787758980.448330:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995620224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787758980.448360:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1787758980.448427:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995620224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758980.448435:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787758980.448519:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2febed2c0 x1874600995620224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758980.448538:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995620224:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787758980.506156:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758981.279899:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758981.281558:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972522240 00000100:00100000:2.0:1787758981.281583:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972522240 00000100:00100000:2.0:1787758981.281669:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 167 00000100:00100000:2.0:1787758981.281681:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+8:5458:x1874600972522240:12345-192.168.204.33@tcp:101: 00010000:00010000:2.0:1787758981.281699:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758981.281720:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c151f000/0x1a77009127f05217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd1a7b4edcc5334d4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758981.281777:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c151f000/0x1a77009127f05217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334d4 expref: 9 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758981.281790:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c151f000/0x1a77009127f05217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334d4 expref: 9 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758981.281799:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c151f000, rc 0) 00000100:00100000:2.0:1787758981.282155:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5458:x1874600972522240:12345-192.168.204.33@tcp:101: Request processed in 474us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758981.282163:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 167 00000100:00100000:0.0:1787758981.293188:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758981.293316:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972522368 00000100:00100000:2.0:1787758981.293327:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972522368 00000100:00100000:2.0:1787758981.293390:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 168 00000100:00100000:2.0:1787758981.293400:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5458:x1874600972522368:12345-192.168.204.33@tcp:501: 00000100:00100000:2.0:1787758981.293747:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5458:x1874600972522368:12345-192.168.204.33@tcp:501: Request processed in 348us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758981.293755:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 168 00000100:00100000:0.0:1787758981.295823:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758981.296998:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972522496 00000100:00100000:2.0:1787758981.297013:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972522496 00000100:00100000:2.0:1787758981.297089:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 169 00000100:00100000:2.0:1787758981.297099:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5458:x1874600972522496:12345-192.168.204.33@tcp:503: 00000100:00100000:2.0:1787758981.297266:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5458:x1874600972522496:12345-192.168.204.33@tcp:503: Request processed in 167us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758981.297274:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 169 00000100:00100000:3.0:1787758981.312434:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758981.312645:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972522624 00000100:00100000:1.0:1787758981.312656:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972522624 00000100:00100000:1.0:1787758981.312718:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 170 00000100:00100000:1.0:1787758981.312729:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5948:x1874600972522624:12345-192.168.204.33@tcp:502: 00000100:00100000:1.0:1787758981.312924:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5948:x1874600972522624:12345-192.168.204.33@tcp:502: Request processed in 197us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758981.312933:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 170 00000100:00100000:1.0:1787758981.322465:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758981.325720:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972522752 00000100:00100000:0.0:1787758981.325735:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972522752 00000100:00100000:0.0:1787758981.327861:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 171 00000100:00100000:0.0:1787758981.327888:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5948:x1874600972522752:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787758981.328077:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5948:x1874600972522752:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 202us (5622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758981.328086:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 171 00000100:00100000:3.0:1787758981.331401:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758981.339422:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972522880 00000100:00100000:1.0:1787758981.339439:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972522880 00000100:00100000:3.0:1787758981.342171:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 172 00000100:00100000:3.0:1787758981.342187:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5458:x1874600972522880:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787758981.342204:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758981.342224:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e350c400/0x1a77009127f0521e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd1a7b4edcc5334db expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758981.342254:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e350c400/0x1a77009127f0521e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334db expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758981.342266:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e350c400/0x1a77009127f0521e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334db expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758981.342275:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e350c400, rc 0) 00000100:00100000:3.0:1787758981.342352:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5458:x1874600972522880:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 169us (10960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758981.342360:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 172 00000100:00100000:3.0:1787758981.350104:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758981.350244:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972523008 00000100:00100000:2.0:1787758981.350269:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972523008 00000100:00100000:2.0:1787758981.350397:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 173 00000100:00100000:2.0:1787758981.350408:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5458:x1874600972523008:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758981.353913:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5458:x1874600972523008:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 3489us (3803us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787758981.353930:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 173 00010000:00010000:0.0:1787758981.530071:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758981.791221:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758981.791262:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758981.791295:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758981.791385:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972523264 00000100:00100000:0.0:1787758981.791394:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972523264 00000100:00100000:0.0:1787758981.791457:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972523392 00000100:00100000:0.0:1787758981.791461:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972523392 00000100:00100000:0.0:1787758981.791487:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:0.0:1787758981.791498:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2364:x1874600972523264:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1787758981.791574:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2364:x1874600972523264:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 78us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758981.791582:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:0.0:1787758981.791599:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:0.0:1787758981.791605:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2364:x1874600972523392:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1787758981.791652:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2364:x1874600972523392:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 46us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758981.791659:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:0.0:1787758981.791719:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972523136 00000100:00100000:0.0:1787758981.791723:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972523136 00000100:00100000:0.0:1787758981.791771:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 34 00000100:00100000:0.0:1787758981.791787:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972523136:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1787758981.791826:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972523136:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 41us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758981.791833:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 34 00000100:00080000:1.0:1787758981.791971:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787758981.791976:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787758981.791986:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787758982.557995:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787758982.829181:0:8882:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd6cdd440 20000000:00000080:0.0:1787758982.829200:0:8882:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88b2fee53400 uarg=0000000000000000 20000000:01000000:0.0:1787758982.829252:0:8882:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787758982.829258:0:8882:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787758982.829264:0:8882:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787758982.830430:0:8883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787758982.832006:0:8882:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787758982.842048:0:8882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787758982.842088:0:8882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787758982.842100:0:8882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787758982.842123:0:8882:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787758982.842147:0:8882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758982.842170:0:8882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2e472aa00/0x1a77009127f04f9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04f93 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758982.842179:0:8882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2c151fe00/0x1a77009127f04ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f04ff5 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758982.842257:0:8882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2c151f800/0x1a77009127f050c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f050c0 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758982.842269:0:8882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f05184 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334a3 expref: 9 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758982.842278:0:8882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758982.842573:0:8882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f05184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334a3 expref: 9 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758982.842593:0:8882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f05184 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334a3 expref: 9 pid: 5946 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758982.842611:0:8882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8882:1874600995620352:192.168.204.33@tcp:104: 00010000:00010000:1.0:1787758982.842786:0:8882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2c151f800/0x1a77009127f050c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f050c0 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758982.842795:0:8882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2c151f800/0x1a77009127f050c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f050c0 expref: 18 pid: 5946 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758982.842806:0:8882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8882:1874600995620480:0@lo:104: 00000100:00100000:1.0:1787758982.842895:0:8882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787758982.842931:0:8882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2c151fe00/0x1a77009127f04ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f04ff5 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758982.842939:0:8882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2c151fe00/0x1a77009127f04ffc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f04ff5 expref: 18 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758982.842947:0:8882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8882:1874600995620608:0@lo:104: 00000100:00100000:1.0:1787758982.842969:0:8882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787758982.842985:0:8882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2e472aa00/0x1a77009127f04f9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f04f93 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758982.842993:0:8882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2e472aa00/0x1a77009127f04f9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f04f93 expref: 18 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758982.843001:0:8882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8882:1874600995620736:0@lo:104: 00000100:00100000:1.0:1787758982.843019:0:8882:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787758982.846355:0:5937:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787758982.846552:0:5937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758982.846636:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995620480 00000100:00100000:2.0:1787758982.846649:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995620480 00000100:00100000:2.0:1787758982.846705:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995620608 00000100:00100000:2.0:1787758982.846709:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995620608 00000100:00100000:2.0:1787758982.846719:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995620736 00000100:00100000:2.0:1787758982.846721:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995620736 00000100:00100000:2.0:1787758982.847797:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787758982.847822:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+5:8882:x1874600995620480:12345-0@lo:104: 00010000:00010000:2.0:1787758982.847859:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f050c7 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758982.847984:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787758982.847991:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+5:8882:x1874600995620480:12345-0@lo:104: Request processed in 181us (5096us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758982.847999:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787758982.848024:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787758982.848042:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b301a44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+4:8882:x1874600995620608:12345-0@lo:104: 00010000:00010000:2.0:1787758982.848052:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04ffc expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758982.848119:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787758982.848125:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b301a44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+4:8882:x1874600995620608:12345-0@lo:104: Request processed in 95us (5155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758982.848132:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787758982.848175:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787758982.848182:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:8882:x1874600995620736:12345-0@lo:104: 00010000:00010000:2.0:1787758982.848190:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2c151e400/0x1a77009127f04f93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04f9a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758982.848223:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787758982.848229:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:8882:x1874600995620736:12345-0@lo:104: Request processed in 48us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758982.848235:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787758982.848262:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787758982.848270:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f050c7 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758982.848279:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2e472a000 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:2.0:1787758982.848284:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f050c7 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758982.848295:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f050c7 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787758982.848304:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f050c7 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758982.848311:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787758982.848359:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f050c7 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758982.848367:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787758982.848391:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f050c7 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.848835:0:6955:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787758982.848875:0:6955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04ffc expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.848884:0:6955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2e350dc00 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:0.0:1787758982.848887:0:6955:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f04ffc expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.848894:0:6955:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f04ffc expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758982.848901:0:6955:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f04ffc expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758982.848907:0:6955:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787758982.848931:0:6955:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04ffc expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.848937:0:6955:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758982.848959:0:6955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04ffc expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.848982:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2e350dc00/0x1a77009127f04ff5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04ffc expref: -99 pid: 6933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.849002:0:6955:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787758982.849005:0:6955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c151e400/0x1a77009127f04f93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f04f9a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.849012:0:6955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c151e400 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:0.0:1787758982.849014:0:6955:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151e400/0x1a77009127f04f93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f04f9a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.849022:0:6955:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c151e400/0x1a77009127f04f93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f04f9a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758982.849028:0:6955:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151e400/0x1a77009127f04f93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f04f9a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758982.849034:0:6955:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787758982.849051:0:6955:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c151e400/0x1a77009127f04f93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f9a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.849057:0:6955:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758982.849063:0:6955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c151e400/0x1a77009127f04f93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f9a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.849069:0:6955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c151e400/0x1a77009127f04f93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f04f9a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.849079:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758982.849086:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758982.849088:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758982.849100:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787758982.849121:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995620864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787758982.849179:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787758982.849645:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2e472a000/0x1a77009127f050c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f050c7 expref: -99 pid: 8010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758982.849668:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758982.849670:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758982.849672:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758982.850145:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995620992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787758982.850204:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758982.850240:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787758982.850247:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995621120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787758982.850301:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758982.850341:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995620864 00000100:00100000:0.0:1787758982.850352:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995620864 00010000:00010000:0.0:1787758982.850399:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2c151f800/0x1a77009127f050c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f050c0 expref: 19 pid: 5946 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758982.850426:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995620992 00000100:00100000:0.0:1787758982.850429:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995620992 00010000:00010000:0.0:1787758982.850439:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2c151fe00/0x1a77009127f04ffc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04ff5 expref: 20 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758982.850450:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995621120 00000100:00100000:0.0:1787758982.850452:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995621120 00010000:00010000:0.0:1787758982.850462:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2e472aa00/0x1a77009127f04f9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04f93 expref: 21 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758982.850477:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787758982.850486:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aa8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+21:3441:x1874600995620864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787758982.850502:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758982.850520:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2c151f800/0x1a77009127f050c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f050c0 expref: 21 pid: 5946 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.850540:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2c151f800/0x1a77009127f050c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f050c0 expref: 21 pid: 5946 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.850567:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787758982.850577:0:5938:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787758982.850590:0:5938:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787758982.850611:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aa8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+21:3441:x1874600995620864:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758982.850620:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787758982.850656:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787758982.850663:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a03840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+20:3443:x1874600995620992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787758982.850672:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758982.850676:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2c151fe00/0x1a77009127f04ffc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04ff5 expref: 20 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.850684:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2c151fe00/0x1a77009127f04ffc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f04ff5 expref: 20 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.850694:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787758982.850725:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a03840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+20:3443:x1874600995620992:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758982.850746:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787758982.850756:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+20:3443:x1874600995621120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787758982.850765:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787758982.850771:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2e472aa00/0x1a77009127f04f9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f04f93 expref: 20 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758982.850783:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2e472aa00/0x1a77009127f04f9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f04f93 expref: 20 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758982.850795:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787758982.850815:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758982.850826:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+20:3443:x1874600995621120:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (523us total) trans 0 rc 0/0 00010000:00010000:1.0:1787758982.850928:0:8882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c151f800/0x1a77009127f050c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f050c0 expref: 20 pid: 5946 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758982.850940:0:8882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8882:1874600995620480:0@lo:104: 00010000:00010000:1.0:1787758982.850955:0:8882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c151fe00/0x1a77009127f04ffc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f04ff5 expref: 19 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758982.850972:0:8882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8882:1874600995620608:0@lo:104: 00010000:00010000:1.0:1787758982.850986:0:8882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2e472aa00/0x1a77009127f04f9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f04f93 expref: 18 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758982.850995:0:8882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8882:1874600995620736:0@lo:104: 00000100:00100000:1.0:1787758982.851922:0:8882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8882:1874600995620352:192.168.204.33@tcp:104: 00010000:00010000:1.0:1787758982.851962:0:8882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758982.852043:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787758982.852095:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995620864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787758982.852125:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aaad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995621120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787758982.852135:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995620992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787758982.853197:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758982.853949:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972523520 00000100:00100000:0.0:1787758982.853963:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972523520 00010000:00010000:0.0:1787758982.854008:0:8884:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f05184 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334a3 expref: 10 pid: 5946 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758982.854074:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 24 00000100:00100000:0.0:1787758982.854086:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2363:x1874600972523520:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787758982.854106:0:8884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758982.854111:0:8884:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f05184 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334a3 expref: 10 pid: 5946 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.854126:0:8884:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f05184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334a3 expref: 10 pid: 5946 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.854150:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f05184 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334a3 expref: 10 pid: 5946 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.854168:0:8884:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.854177:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.854209:0:8884:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.854217:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.854224:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.854231:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.854247:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2fe4cf800 already unused, calling callback (ffffffffc0e68530) 00010000:00010000:0.0:1787758982.854252:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.854261:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.854282:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758982.854293:0:8884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787758982.854385:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:2363:x1874600972523520:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 301us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758982.854394:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 24 00010000:00010000:3.0:1787758982.855103:0:8882:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758982.855116:0:8882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758982.855132:0:8882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2fe4cf800/0x1a77009127f05225 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758982.855921:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787758983.249563:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787758983.249982:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972523648 00000100:00100000:2.0:1787758983.249996:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972523648 00000100:00100000:2.0:1787758983.250225:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 174 00000100:00100000:2.0:1787758983.250253:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5458:x1874600972523648:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787758983.250277:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758983.250307:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c151e200/0x1a77009127f0522c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd1a7b4edcc5334e2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758983.250402:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c151e200/0x1a77009127f0522c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334e2 expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758983.250417:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c151e200/0x1a77009127f0522c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334e2 expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758983.250429:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c151e200, rc 0) 00000100:00100000:2.0:1787758983.250511:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5458:x1874600972523648:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 258us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758983.250522:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 174 00000100:00100000:3.0:1787758983.261297:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787758983.263815:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972523776 00000100:00100000:1.0:1787758983.263900:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972523776 00000100:00100000:1.0:1787758983.264016:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 175 00000100:00100000:1.0:1787758983.264030:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5458:x1874600972523776:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758983.264596:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5458:x1874600972523776:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 564us (3310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758983.264608:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 175 00000100:00100000:3.0:1787758983.272689:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758983.273331:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972523904 00000100:00100000:0.0:1787758983.273412:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972523904 00000100:00100000:0.0:1787758983.273485:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 176 00000100:00100000:0.0:1787758983.273498:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5458:x1874600972523904:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787758983.273697:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5458:x1874600972523904:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 200us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758983.273706:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 176 00000100:00100000:3.0:1787758983.296540:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758983.296773:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972524032 00000100:00100000:0.0:1787758983.296786:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972524032 00000100:00100000:0.0:1787758983.296916:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 177 00000100:00100000:0.0:1787758983.296929:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5999:x1874600972524032:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787758983.297139:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5999:x1874600972524032:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 212us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758983.297155:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 177 00000100:00100000:0.0:1787758983.303373:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787758983.303711:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972524160 00000100:00100000:3.0:1787758983.303736:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972524160 00000100:00100000:3.0:1787758983.303815:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 178 00000100:00100000:3.0:1787758983.303827:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5999:x1874600972524160:12345-192.168.204.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787758983.304094:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5999:x1874600972524160:12345-192.168.204.33@tcp:502:llog_process_th.0 Request processed in 268us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758983.304103:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 178 00010000:00010000:3.0:1787758983.579163:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787758984.345967:0:5950:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787758984.345975:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b2fe715800 from 4 10000000:01000000:3.0:1787758984.345981:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787758984.346032:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758984.346046:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758984.346059:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758984.346086:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995621248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787758984.346175:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758984.346262:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e4bee180 going to sleep for 11 seconds 00000100:00100000:0.0:1787758984.346394:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995621248 00000100:00100000:0.0:1787758984.346409:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995621248 00000100:00100000:0.0:1787758984.346553:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787758984.346566:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995621248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787758984.346587:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758984.346607:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e472a200/0x1a77009127f0523a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f05233 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758984.346640:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e472a200/0x1a77009127f0523a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f05233 expref: 17 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758984.346667:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e472a200/0x1a77009127f0523a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05233 expref: 17 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758984.346679:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e472a200, rc 0) 00000100:00100000:0.0:1787758984.348937:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995621248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2360us (2748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758984.348953:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787758984.349573:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995621248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787758984.349607:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0523a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758984.349622:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f0523a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758984.350123:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995621376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758984.350195:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758984.350316:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d153c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758984.350395:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995621376 00000100:00100000:0.0:1787758984.350402:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995621376 00000100:00100000:0.0:1787758984.350457:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787758984.350467:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995621376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758984.350625:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995621376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758984.350632:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787758984.350985:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995621376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758984.351025:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995621504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758984.351078:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758984.351110:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d153c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758984.351161:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995621504 00000100:00100000:3.0:1787758984.351167:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995621504 00000100:00100000:3.0:1787758984.351206:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787758984.351215:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995621504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787758984.351320:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995621504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758984.351328:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787758984.351403:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995621504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758984.353304:0:8915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8915:1874600995621632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758984.353402:0:8915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758984.353461:0:8915:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787758984.353522:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995621632 00000100:00100000:3.0:1787758984.353530:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995621632 00000100:00100000:3.0:1787758984.353587:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787758984.353596:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:8915:x1874600995621632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758984.353961:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:8915:x1874600995621632:12345-0@lo:502:llog_process_th.0 Request processed in 365us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758984.353970:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787758984.354107:0:8915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8915:1874600995621632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787758984.354141:0:8915:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787758984.354154:0:8915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758984.354157:0:8915:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787758984.354164:0:8915:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b2fe715800 00000020:00000080:1.0:1787758984.354167:0:8915:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787758984.354265:0:8915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8915:1874600995621760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758984.354302:0:8915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758984.355018:0:8915:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787758984.357451:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995621760 00000100:00100000:0.0:1787758984.358005:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995621760 00000100:00100000:0.0:1787758984.358103:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787758984.358118:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:8915:x1874600995621760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758984.358350:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:8915:x1874600995621760:12345-0@lo:502:llog_process_th.0 Request processed in 235us (4045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758984.358359:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787758984.359826:0:8915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8915:1874600995621760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787758984.359904:0:8915:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787758984.359914:0:8915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758984.359917:0:8915:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787758984.359921:0:8915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787758984.360399:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787758984.360432:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787758984.360445:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0523a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758984.360459:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0523a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758984.360472:0:5950:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787758984.360475:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b301aae000 from 4 10000000:01000000:2.0:1787758984.360478:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787758984.360520:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758984.360529:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758984.360550:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758984.360578:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995621888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787758984.360650:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758984.360882:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92ddd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787758984.360964:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995621888 00000100:00100000:1.0:1787758984.360972:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995621888 00000100:00100000:1.0:1787758984.361029:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787758984.361048:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995621888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787758984.361066:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758984.361081:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2fe4cf200/0x1a77009127f05248 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f05241 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758984.361109:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2fe4cf200/0x1a77009127f05248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f05241 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758984.361122:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2fe4cf200/0x1a77009127f05248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05241 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758984.361131:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2fe4cf200, rc 0) 00000100:00100000:1.0:1787758984.361240:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995621888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758984.361247:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787758984.367024:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995621888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787758984.367065:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05248 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758984.367083:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f05248 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758984.367447:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995622016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758984.367547:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758984.367606:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c9e32000 going to sleep for 11 seconds 00000100:00100000:2.0:1787758984.368529:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995622016 00000100:00100000:2.0:1787758984.368540:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995622016 00000100:00100000:2.0:1787758984.368615:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787758984.368628:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995622016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758984.368896:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995622016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758984.368905:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787758984.368965:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995622016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758984.369024:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995622144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758984.369086:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758984.369116:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dde40 going to sleep for 11 seconds 00000100:00100000:2.0:1787758984.369131:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995622144 00000100:00100000:2.0:1787758984.369135:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995622144 00000100:00100000:2.0:1787758984.369162:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787758984.369170:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995622144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758984.369262:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995622144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758984.369270:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787758984.369319:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995622144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758984.369578:0:8917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8917:1874600995622272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758984.369614:0:8917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758984.369633:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995622272 00000100:00100000:2.0:1787758984.369637:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995622272 00000100:00100000:2.0:1787758984.369660:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787758984.369666:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:8917:x1874600995622272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758984.369753:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:8917:x1874600995622272:12345-0@lo:502:llog_process_th.0 Request processed in 87us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758984.369760:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787758984.369789:0:8917:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758984.369801:0:8917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8917:1874600995622272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787758984.369823:0:8917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787758984.369836:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758984.369868:0:8917:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787758984.369877:0:8917:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b301aae000 00000020:00000080:2.0:1787758984.369879:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787758984.369985:0:8917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8917:1874600995622400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758984.370019:0:8917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758984.370037:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995622400 00000100:00100000:2.0:1787758984.370041:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995622400 00000100:00100000:2.0:1787758984.370063:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787758984.370069:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:8917:x1874600995622400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758984.370130:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:8917:x1874600995622400:12345-0@lo:502:llog_process_th.0 Request processed in 60us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758984.370137:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787758984.370171:0:8917:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758984.370183:0:8917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8917:1874600995622400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787758984.370199:0:8917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787758984.370203:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758984.370205:0:8917:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787758984.370208:0:8917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787758984.370276:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787758984.370304:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787758984.370316:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05248 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758984.370329:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05248 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758984.370341:0:5950:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787758984.370345:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b2e05c4000 from 4 10000000:01000000:2.0:1787758984.370348:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787758984.370378:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758984.370387:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758984.370397:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758984.370409:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995622528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787758984.370436:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758984.370451:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758984.370462:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995622528 00000100:00100000:2.0:1787758984.370472:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995622528 00000100:00100000:2.0:1787758984.370494:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787758984.370500:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995622528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787758984.370510:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758984.370526:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2c151f400/0x1a77009127f05256 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f0524f expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758984.370550:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2c151f400/0x1a77009127f05256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f0524f expref: 19 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758984.370562:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2c151f400/0x1a77009127f05256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f0524f expref: 19 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758984.370571:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c151f400, rc 0) 00000100:00100000:2.0:1787758984.370602:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995622528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758984.370608:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787758984.370642:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995622528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787758984.370655:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05256 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758984.370665:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f05256 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758984.370726:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995622656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758984.370752:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758984.370765:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758984.370776:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995622656 00000100:00100000:2.0:1787758984.370787:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995622656 00000100:00100000:2.0:1787758984.370810:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787758984.370816:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995622656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758984.370930:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995622656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758984.370937:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787758984.370975:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995622656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758984.370999:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995622784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758984.371034:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758984.371063:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758984.371077:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995622784 00000100:00100000:2.0:1787758984.371080:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995622784 00000100:00100000:2.0:1787758984.371102:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787758984.371107:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995622784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758984.371175:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995622784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758984.371182:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787758984.371218:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995622784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787758984.380776:0:8918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febee1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8918:1874600995622912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758984.381056:0:8918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758984.381155:0:8918:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2fed44b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787758984.381199:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995622912 00000100:00100000:2.0:1787758984.381209:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995622912 00000100:00100000:2.0:1787758984.381583:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787758984.381598:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:8918:x1874600995622912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758984.381783:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:8918:x1874600995622912:12345-0@lo:502:llog_process_th.0 Request processed in 182us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758984.381792:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787758984.382071:0:8918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febee1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8918:1874600995622912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787758984.382112:0:8918:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787758984.382125:0:8918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787758984.382128:0:8918:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787758984.382137:0:8918:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b2e05c4000 00000020:00000080:3.0:1787758984.382140:0:8918:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787758984.382322:0:8918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febee1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8918:1874600995623040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758984.382652:0:8918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758984.382696:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995623040 00000100:00100000:3.0:1787758984.382710:0:8918:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2fed44b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787758984.382716:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995623040 00000100:00100000:2.0:1787758984.382769:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787758984.382825:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:8918:x1874600995623040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758984.382942:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:8918:x1874600995623040:12345-0@lo:502:llog_process_th.0 Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758984.384557:0:8918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febee1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:8918:1874600995623040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787758984.384610:0:8918:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787758984.384619:0:8918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787758984.384622:0:8918:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787758984.384627:0:8918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787758984.384954:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787758984.384981:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787758984.384993:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05256 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758984.385007:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05256 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758984.387262:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00010000:00010000:2.0:1787758984.603074:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758985.566496:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995623168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787758985.566606:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758985.566727:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995623168 00000100:00100000:0.0:1787758985.566737:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995623168 00000100:00100000:0.0:1787758985.566817:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787758985.566827:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aa9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995623168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787758985.566894:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1787758985.566950:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aa9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995623168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758985.566968:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787758985.566995:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787758985.567035:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2e36d8f00 x1874600995623168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758985.567060:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995623168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787758985.570325:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995623424:0@lo:400:kworker.0 00000100:00100000:1.0:1787758985.571351:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758985.571528:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995623424 00000100:00100000:3.0:1787758985.571538:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995623424 00000100:00100000:3.0:1787758985.571612:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787758985.571624:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995623424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787758985.571714:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995623424:12345-0@lo:400:kworker.0 Request processed in 93us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758985.571722:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787758985.572206:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995623936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787758985.573409:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758985.573564:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995623424:0@lo:400:kworker.0 00000100:00100000:1.0:1787758985.573598:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787758985.573609:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995623552:0@lo:400:kworker.0 00000100:00100000:1.0:1787758985.573639:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758985.573993:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995623552 00000100:00100000:1.0:1787758985.574001:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995623552 00000100:00100000:1.0:1787758985.574068:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787758985.574079:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995623552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758985.580638:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995623552:12345-0@lo:400:kworker.0 Request processed in 6545us (6981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758985.580660:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787758985.582082:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995623552:0@lo:400:kworker.0 00000100:00100000:1.0:1787758985.584033:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995623296:0@lo:400:kworker.0 00000100:00100000:1.0:1787758985.584138:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758985.584210:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995623808:0@lo:400:kworker.0 00000100:00100000:2.0:1787758985.584338:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995623296 00000100:00100000:2.0:1787758985.584350:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995623296 00000100:00100000:2.0:1787758985.584422:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787758985.584434:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3442:x1874600995623296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758985.592023:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758985.592109:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787758985.592131:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3442:1874600995623680:0@lo:400:kworker.0 00000100:00100000:1.0:1787758985.592203:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787758985.592496:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787758985.592522:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995623680 00000100:00100000:1.0:1787758985.592531:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995623680 00000100:00100000:1.0:1787758985.592605:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787758985.592617:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1874600995623680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758985.592702:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1874600995623680:12345-0@lo:400:kworker.0 Request processed in 86us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758985.592711:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787758985.592737:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787758985.592751:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995623936 00000100:00100000:1.0:1787758985.592755:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995623936 00000100:00100000:1.0:1787758985.592792:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787758985.592800:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995623936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787758985.592830:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1787758985.593274:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995623808 00000100:00100000:2.0:1787758985.593280:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995623808 00000100:00100000:2.0:1787758985.593326:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787758985.593335:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3442:x1874600995623808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758985.593381:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3442:x1874600995623808:12345-0@lo:400:kworker.0 Request processed in 48us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758985.593387:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787758985.593571:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995623936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 771us (20167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758985.593595:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787758985.593617:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787758985.593662:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3442:1874600995623680:0@lo:400:kworker.0 00010000:00080000:1.0:1787758985.593690:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fedc7840 x1874600995623808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758985.593701:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995623808:0@lo:400:kworker.0 00010000:00080000:1.0:1787758985.593740:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2febee1c0 x1874600995623936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758985.593757:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995623936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787758985.597481:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3442:x1874600995623296:12345-0@lo:400:kworker.0 Request processed in 13033us (13328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758985.597503:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787758985.597733:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995623296:0@lo:400:kworker.0 00010000:00010000:2.0:1787758985.631001:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758986.650047:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758986.923942:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787758986.924041:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787758986.924086:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787758986.924127:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787758986.924168:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972524416 00000100:00100000:3.0:1787758986.924181:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972524416 00000100:00100000:3.0:1787758986.924286:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 38 00000100:00100000:3.0:1787758986.924302:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972524416:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1787758986.924409:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972524416:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 111us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758986.924418:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 38 00000100:00080000:3.0:1787758986.924443:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787758986.924818:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972524288 00000100:00100000:1.0:1787758986.924824:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972524288 00000100:00100000:1.0:1787758986.924885:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 195 00000100:00100000:1.0:1787758986.924894:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972524288:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1787758986.924928:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972524288:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 37us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758986.924935:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 195 00000100:00100000:0.0:1787758986.926946:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972524544 00000100:00100000:0.0:1787758986.926965:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972524544 00000100:00100000:0.0:1787758986.927066:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972524672 00000100:00100000:0.0:1787758986.927070:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972524672 00000100:00100000:0.0:1787758986.927104:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 18 00000100:00100000:0.0:1787758986.927115:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2364:x1874600972524544:12345-192.168.204.33@tcp:400:kworker.0 00000100:00080000:3.0:1787758986.927196:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787758986.927203:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787758986.927207:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2364:x1874600972524544:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 91us (3163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758986.927217:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 18 00000100:00100000:0.0:1787758986.927236:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 19 00000100:00100000:0.0:1787758986.927243:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2364:x1874600972524672:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1787758986.927272:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2364:x1874600972524672:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 29us (3157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758986.927278:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 19 00010000:00010000:1.0:1787758987.674793:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758988.701824:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758989.722151:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758990.684426:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995624064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787758990.684502:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758990.684898:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995624064 00000100:00100000:3.0:1787758990.684971:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995624064 00000100:00100000:3.0:1787758990.685035:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787758990.685044:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995624064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787758990.685073:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787758990.685122:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995624064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758990.685129:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787758990.685150:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787758990.685179:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2febec3c0 x1874600995624064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758990.685199:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995624064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787758990.687770:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995624192:0@lo:400:kworker.0 00000100:00100000:3.0:1787758990.691677:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758990.691735:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3441:1874600995624704:0@lo:400:kworker.0 00000100:00100000:3.0:1787758990.691770:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758990.691998:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995624192 00000100:00100000:2.0:1787758990.692007:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995624192 00000100:00100000:2.0:1787758990.692060:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787758990.692070:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995624192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758990.692125:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995624192:12345-0@lo:400:kworker.0 Request processed in 57us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758990.692150:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787758990.692703:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995624192:0@lo:400:kworker.0 00000100:00100000:3.0:1787758990.692721:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787758990.692729:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995624320:0@lo:400:kworker.0 00000100:00100000:3.0:1787758990.692755:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758990.692998:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995624704 00000100:00100000:1.0:1787758990.693004:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995624704 00000100:00100000:1.0:1787758990.693048:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995624320 00000100:00100000:1.0:1787758990.693050:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995624320 00000100:00100000:1.0:1787758990.693069:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787758990.693077:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1874600995624704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758990.693130:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1874600995624704:12345-0@lo:400:kworker.0 Request processed in 54us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758990.693136:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787758990.693150:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787758990.693156:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995624320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758990.693187:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995624320:12345-0@lo:400:kworker.0 Request processed in 32us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758990.693192:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787758990.693500:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995624320:0@lo:400:kworker.0 00000100:00100000:3.0:1787758990.693511:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995624832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787758990.693553:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758990.693936:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995624448:0@lo:400:kworker.0 00000100:00100000:2.0:1787758990.693973:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758990.693999:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787758990.694005:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995624576:0@lo:400:kworker.0 00000100:00100000:2.0:1787758990.694030:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758990.694062:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995624448 00000100:00100000:2.0:1787758990.694067:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995624448 00000100:00100000:2.0:1787758990.694098:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787758990.694105:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995624448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758990.694145:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995624448:12345-0@lo:400:kworker.0 Request processed in 41us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758990.694151:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787758990.694170:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995624576 00000100:00100000:2.0:1787758990.694174:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995624576 00000100:00100000:2.0:1787758990.694224:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787758990.694232:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995624576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758990.694264:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995624576:12345-0@lo:400:kworker.0 Request processed in 33us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758990.694270:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1787758990.694303:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2febeda40 x1874600995624576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758990.694317:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995624576:0@lo:400:kworker.0 00000100:00100000:2.0:1787758990.694345:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995624448:0@lo:400:kworker.0 00000100:00100000:3.0:1787758990.695477:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3441:1874600995624704:0@lo:400:kworker.0 00000100:00080000:3.0:1787758990.695525:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787758990.695530:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787758990.695675:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995624832 00000100:00100000:2.0:1787758990.695691:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995624832 00000100:00100000:2.0:1787758990.695737:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787758990.695746:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995624832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787758990.696004:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1787758990.696081:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995624832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 335us (2526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758990.696088:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787758990.696677:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe6f3480 x1874600995624832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758990.696699:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995624832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787758990.746050:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787758991.634027:0:9182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1787758991.769977:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758992.040992:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758992.042225:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972524800 00000100:00100000:0.0:1787758992.042239:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972524800 00000100:00100000:0.0:1787758992.042309:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 197 00000100:00100000:0.0:1787758992.042330:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972524800:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1787758992.047387:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972524800:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 5056us (6393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758992.047416:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 197 00000100:00100000:3.0:1787758992.055443:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787758992.055616:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972524928 00000100:00100000:3.0:1787758992.055627:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972524928 00000100:00100000:3.0:1787758992.055709:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:3.0:1787758992.055719:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972524928:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1787758992.055799:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972524928:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 81us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758992.055807:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 42 00000100:00100000:0.0:1787758992.055940:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758992.056571:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00080000:3.0:1787758992.056775:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787758992.057661:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972525056 00000100:00100000:0.0:1787758992.057678:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972525056 00000100:00100000:0.0:1787758992.057756:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972525184 00000100:00100000:0.0:1787758992.057760:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972525184 00000100:00080000:3.0:1787758992.059464:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787758992.059472:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787758992.059639:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:0.0:1787758992.059659:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aaad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2361:x1874600972525056:12345-192.168.204.33@tcp:9:kworker.0 00000020:00000080:0.0:1787758992.059714:0:6940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a77009127f05192 00000100:00080000:0.0:1787758992.059725:0:6940:0:(import.c:65:import_set_state_nolock()) ffff88b2e0e17000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787758992.059858:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:2.0:1787758992.059871:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+5:2361:x1874600972525184:12345-192.168.204.33@tcp:9:kworker.0 00000020:00000080:2.0:1787758992.059891:0:6942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a77009127f05199 00000100:00080000:2.0:1787758992.059897:0:6942:0:(import.c:65:import_set_state_nolock()) ffff88b2fec18800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787758992.059934:0:6942:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787758992.060124:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+2:2361:x1874600972525184:12345-192.168.204.33@tcp:9:kworker.0 Request processed in 257us (3554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758992.060133:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 11 00010000:00010000:2.0:1787758992.060200:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787758992.061559:0:6940:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787758992.061743:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aaad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+2:2361:x1874600972525056:12345-192.168.204.33@tcp:9:kworker.0 Request processed in 2087us (5797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758992.061753:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 10 00010000:00010000:3.0:1787758992.061988:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758992.794015:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758993.818092:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758994.842559:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758995.804423:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787758995.804458:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995624960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787758995.804570:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758995.804805:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787758995.804815:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995625088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787758995.804873:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758995.804909:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995624960 00000100:00100000:3.0:1787758995.804917:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995624960 00000100:00100000:3.0:1787758995.804992:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995625088 00000100:00100000:3.0:1787758995.804996:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995625088 00000100:00100000:3.0:1787758995.805016:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787758995.805026:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995624960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787758995.805062:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787758995.805392:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995624960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 366us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758995.805401:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787758995.805421:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787758995.805428:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995625088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787758995.805446:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787758995.805489:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995625088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758995.805496:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787758995.805516:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787758995.805521:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787758995.805550:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe6af840 x1874600995625088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758995.805594:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995625088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787758995.806337:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995625472:0@lo:400:kworker.0 00000100:00100000:0.0:1787758995.806386:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758995.806419:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787758995.806425:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3443:1874600995625600:0@lo:400:kworker.0 00000100:00100000:0.0:1787758995.806445:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758995.806475:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995625472 00000100:00100000:0.0:1787758995.806499:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995625472 00000100:00100000:0.0:1787758995.806547:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995625600 00000100:00100000:0.0:1787758995.806558:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995625600 00000100:00100000:0.0:1787758995.806590:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787758995.806597:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995625472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787758995.806640:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995625472:12345-0@lo:400:kworker.0 Request processed in 43us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758995.806647:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787758995.806663:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787758995.806668:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1874600995625600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787758995.806692:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1874600995625600:12345-0@lo:400:kworker.0 Request processed in 24us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758995.806697:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787758995.806716:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787758995.806750:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3443:1874600995625600:0@lo:400:kworker.0 00000100:00100000:0.0:1787758995.806760:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995625472:0@lo:400:kworker.0 00010000:00080000:0.0:1787758995.806787:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fedc7c00 x1874600995624960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758995.806805:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995624960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787758995.807601:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3442:1874600995625344:0@lo:400:kworker.0 00000100:00100000:3.0:1787758995.807652:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758995.807683:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787758995.807689:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e4aa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995625216:0@lo:400:kworker.0 00000100:00100000:3.0:1787758995.807720:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758995.807763:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995625216 00000100:00100000:3.0:1787758995.807770:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995625216 00000100:00100000:3.0:1787758995.807808:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787758995.807816:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3442:x1874600995625216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787758995.807904:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3442:x1874600995625216:12345-0@lo:400:kworker.0 Request processed in 89us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758995.807911:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787758995.812536:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e4aa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995625216:0@lo:400:kworker.0 00000100:00100000:1.0:1787758995.812621:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995625344 00000100:00100000:1.0:1787758995.812631:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995625344 00000100:00100000:1.0:1787758995.814233:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787758995.814262:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1874600995625344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758995.814416:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1874600995625344:12345-0@lo:400:kworker.0 Request processed in 167us (6763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758995.814425:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787758995.814588:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3442:1874600995625344:0@lo:400:kworker.0 00010000:00010000:2.0:1787758995.869282:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758996.892748:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758997.155308:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787758997.155374:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787758997.157286:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972525312 00000100:00100000:3.0:1787758997.157303:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972525312 00000100:00100000:3.0:1787758997.157409:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 199 00000100:00100000:3.0:1787758997.157421:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2362:x1874600972525312:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1787758997.157532:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2362:x1874600972525312:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 112us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758997.157542:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 199 00000100:00100000:2.0:1787758997.158133:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972525440 00000100:00100000:2.0:1787758997.158143:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972525440 00000100:00100000:2.0:1787758997.158209:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 46 00000100:00100000:2.0:1787758997.158220:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2362:x1874600972525440:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1787758997.158277:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2362:x1874600972525440:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 60us (2903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758997.158295:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 46 00000100:00080000:3.0:1787758997.159004:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1787758997.855614:0:6935:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2fdb7338-6109-4f60-9752-fc8ea99264a4 00000020:00000080:2.0:1787758997.855627:0:6935:0:(genops.c:885:class_export_put()) final put ffff88b2e0e14000/2fdb7338-6109-4f60-9752-fc8ea99264a4 00000020:00000080:1.0:1787758997.855900:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b2e0e14000/2fdb7338-6109-4f60-9752-fc8ea99264a4 for lustre-OST0000 00000020:00000080:1.0:1787758997.855957:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88b2e0e17000 for lustre-OST0000 00000001:00100000:2.0:1787758997.876208:0:8011:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2fdb7338-6109-4f60-9752-fc8ea99264a4 00000020:00000080:2.0:1787758997.876222:0:8011:0:(genops.c:885:class_export_put()) final put ffff88b2fec1b800/2fdb7338-6109-4f60-9752-fc8ea99264a4 00000020:00000080:2.0:1787758997.876271:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b2fec1b800/2fdb7338-6109-4f60-9752-fc8ea99264a4 for lustre-OST0001 00000020:00000080:2.0:1787758997.876331:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88b2fec18800 for lustre-OST0001 00010000:00010000:3.0:1787758997.914046:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758998.948949:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787758999.411951:0:9426:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing yml_node 00010000:00010000:2.0:1787758999.962610:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759000.922152:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995625728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787759000.922227:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759000.922545:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995625728 00000100:00100000:3.0:1787759000.922558:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995625728 00000100:00100000:3.0:1787759000.922620:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787759000.922628:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995625728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787759000.922656:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787759000.922702:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995625728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759000.922708:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787759000.922756:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2febee1c0 x1874600995625728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759000.922774:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995625728:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787759000.923077:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787759000.926597:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787759000.926621:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fedc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995625856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787759000.926686:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759000.927151:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3442:1874600995626368:0@lo:400:kworker.0 00000100:00100000:3.0:1787759000.927186:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759000.927214:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787759000.927220:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3442:1874600995626240:0@lo:400:kworker.0 00000100:00100000:3.0:1787759000.927263:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759000.927521:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995625984:0@lo:400:kworker.0 00000100:00100000:0.0:1787759000.927559:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759000.927591:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787759000.927597:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995626112:0@lo:400:kworker.0 00000100:00100000:0.0:1787759000.927619:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759000.927654:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995626368 00000100:00100000:0.0:1787759000.927661:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995626368 00000100:00100000:0.0:1787759000.927709:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995626240 00000100:00100000:0.0:1787759000.927711:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995626240 00000100:00100000:0.0:1787759000.927722:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995626112 00000100:00100000:0.0:1787759000.927723:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995626112 00000100:00100000:0.0:1787759000.927750:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787759000.927759:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1874600995626368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759000.927814:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1874600995626368:12345-0@lo:400:kworker.0 Request processed in 56us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759000.927821:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787759000.927859:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787759000.927866:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1874600995626240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759000.927894:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1874600995626240:12345-0@lo:400:kworker.0 Request processed in 29us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759000.927900:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787759000.927912:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787759000.927917:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995626112:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787759000.928115:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787759000.928149:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3442:1874600995626240:0@lo:400:kworker.0 00000100:00100000:2.0:1787759000.928159:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3442:1874600995626368:0@lo:400:kworker.0 00000100:00100000:0.0:1787759000.928285:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995626112:12345-0@lo:400:kworker.0 Request processed in 367us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759000.928292:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787759000.928478:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995625984 00000100:00100000:3.0:1787759000.928483:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995625984 00000100:00100000:3.0:1787759000.928518:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787759000.928525:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf3d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3443:x1874600995625984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759000.928558:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf3d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3443:x1874600995625984:12345-0@lo:400:kworker.0 Request processed in 34us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759000.928564:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787759000.928702:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995625856 00000100:00100000:1.0:1787759000.928707:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995625856 00000100:00100000:1.0:1787759000.928768:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787759000.928775:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995625856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787759000.928800:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787759000.928871:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995625856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759000.928877:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787759000.928908:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fedc5680 x1874600995625856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759000.928927:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fedc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995625856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787759000.929203:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995626112:0@lo:400:kworker.0 00000100:00100000:2.0:1787759000.929215:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995625984:0@lo:400:kworker.0 00000100:00080000:3.0:1787759000.929276:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787759000.994534:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759002.010071:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759002.274337:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787759002.274401:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787759002.274679:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972525696 00000100:00100000:2.0:1787759002.274691:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972525696 00000100:00100000:2.0:1787759002.274788:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 50 00000100:00100000:2.0:1787759002.274800:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972525696:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1787759002.275078:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972525696:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 280us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759002.275124:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972525568 00000100:00100000:3.0:1787759002.275129:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972525568 00000100:00100000:3.0:1787759002.275187:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 201 00000100:00100000:3.0:1787759002.275195:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972525568:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1787759002.275222:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972525568:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 29us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759002.275230:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 201 00000100:00100000:2.0:1787759002.275366:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 50 00000100:00080000:0.0:1787759002.275920:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787759003.037796:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759004.058274:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759005.082088:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759006.042115:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3444:1874600995626624:0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.042189:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759006.042238:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995627136:0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.042266:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759006.042307:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787759006.042314:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995626496:0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.042523:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759006.042550:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3444:1874600995627008:0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.042573:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759006.042599:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995626880:0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.042622:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759006.042642:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787759006.042647:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3442:1874600995626752:0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.042669:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759006.042698:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995626496 00000100:00100000:3.0:1787759006.042704:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995626496 00000100:00100000:3.0:1787759006.042749:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787759006.042759:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3444:x1874600995626496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.042807:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3444:x1874600995626496:12345-0@lo:400:kworker.0 Request processed in 50us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759006.042824:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787759006.042965:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995626624 00000100:00100000:3.0:1787759006.042970:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995626624 00000100:00100000:3.0:1787759006.042997:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995627008 00000100:00100000:3.0:1787759006.042999:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995627008 00000100:00100000:3.0:1787759006.043020:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995626752 00000100:00100000:3.0:1787759006.043023:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995626752 00000100:00100000:3.0:1787759006.043037:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787759006.043043:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1874600995626624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.043075:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1874600995626624:12345-0@lo:400:kworker.0 Request processed in 32us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759006.043081:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787759006.043093:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787759006.043099:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1874600995627008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.043125:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1874600995627008:12345-0@lo:400:kworker.0 Request processed in 27us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759006.043131:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787759006.043142:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787759006.043148:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1874600995626752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.043177:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1874600995626752:12345-0@lo:400:kworker.0 Request processed in 30us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759006.043182:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787759006.043200:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995627136 00000100:00100000:3.0:1787759006.043204:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995627136 00000100:00100000:3.0:1787759006.043227:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995626880 00000100:00100000:3.0:1787759006.043230:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995626880 00000100:00100000:3.0:1787759006.043250:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787759006.043264:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995627136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.043308:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995627136:12345-0@lo:400:kworker.0 Request processed in 45us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759006.043314:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787759006.043326:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787759006.043332:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995626880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.043358:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995626880:12345-0@lo:400:kworker.0 Request processed in 26us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759006.043363:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787759006.043387:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787759006.043391:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787759006.043393:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787759006.043423:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3442:1874600995626752:0@lo:400:kworker.0 00010000:00080000:3.0:1787759006.043437:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee71e00 x1874600995626880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759006.043447:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995626880:0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.043552:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995626496:0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.043566:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3444:1874600995627008:0@lo:400:kworker.0 00000100:00100000:3.0:1787759006.043575:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3444:1874600995626624:0@lo:400:kworker.0 00010000:00080000:3.0:1787759006.043583:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee730c0 x1874600995627136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759006.043591:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995627136:0@lo:400:kworker.0 00000100:00100000:0.0:1787759006.043808:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787759006.043817:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995627264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787759006.043934:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759006.044011:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995627264 00000100:00100000:1.0:1787759006.044016:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995627264 00000100:00100000:1.0:1787759006.044052:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787759006.044060:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995627264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787759006.044082:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787759006.044128:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995627264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759006.044135:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787759006.044165:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee9e940 x1874600995627264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759006.044179:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995627264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787759006.044348:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787759006.044358:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995627392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787759006.044384:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759006.044479:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995627392 00000100:00100000:3.0:1787759006.044489:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995627392 00000100:00100000:3.0:1787759006.044521:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787759006.044528:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995627392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787759006.044543:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787759006.044585:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995627392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759006.044592:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787759006.044659:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee730c0 x1874600995627392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759006.044672:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995627392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787759006.109681:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787759006.243103:0:9610:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.104 00010000:00010000:3.0:1787759007.145507:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759007.393534:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787759007.393584:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787759007.393619:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972525824 00000100:00100000:2.0:1787759007.393628:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972525824 00000100:00100000:2.0:1787759007.393678:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 203 00000100:00100000:2.0:1787759007.393689:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2363:x1874600972525824:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1787759007.393759:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2363:x1874600972525824:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 71us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759007.393766:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 203 00000100:00100000:1.0:1787759007.394944:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972525952 00000100:00100000:1.0:1787759007.394952:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972525952 00000100:00100000:1.0:1787759007.395010:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 54 00000100:00100000:1.0:1787759007.395019:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2363:x1874600972525952:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1787759007.395070:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2363:x1874600972525952:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 52us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759007.395077:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 54 00000100:00080000:0.0:1787759007.396509:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787759008.154002:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759009.181225:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759010.206455:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787759010.238820:0:9708:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.104 00000100:00100000:3.0:1787759011.162465:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3441:1874600995627776:0@lo:400:kworker.0 00000100:00100000:3.0:1787759011.162563:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759011.162647:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787759011.162667:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995627904:0@lo:400:kworker.0 00000100:00100000:3.0:1787759011.162698:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759011.162746:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995627776 00000100:00100000:3.0:1787759011.162754:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995627776 00000100:00100000:3.0:1787759011.162859:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787759011.162870:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1874600995627776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759011.162930:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1874600995627776:12345-0@lo:400:kworker.0 Request processed in 63us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759011.162938:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787759011.162962:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995627904 00000100:00100000:3.0:1787759011.162966:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995627904 00000100:00100000:3.0:1787759011.162991:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787759011.162997:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995627904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759011.163028:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995627904:12345-0@lo:400:kworker.0 Request processed in 31us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759011.163058:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787759011.163088:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787759011.163094:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787759011.163135:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee70b40 x1874600995627904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759011.163150:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995627904:0@lo:400:kworker.0 00000100:00100000:3.0:1787759011.163162:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3441:1874600995627776:0@lo:400:kworker.0 00000100:00100000:2.0:1787759011.163282:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995627520:0@lo:400:kworker.0 00000100:00100000:2.0:1787759011.163325:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759011.163358:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3443:1874600995628032:0@lo:400:kworker.0 00000100:00100000:2.0:1787759011.163382:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759011.163405:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787759011.163411:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995627648:0@lo:400:kworker.0 00000100:00100000:2.0:1787759011.163434:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759011.163452:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995628160:0@lo:400:kworker.0 00000100:00100000:2.0:1787759011.163473:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759011.163502:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995628032 00000100:00100000:2.0:1787759011.163507:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995628032 00000100:00100000:2.0:1787759011.163539:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995627648 00000100:00100000:2.0:1787759011.163549:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995627648 00000100:00100000:2.0:1787759011.163572:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787759011.163578:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1874600995628032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759011.163616:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1874600995628032:12345-0@lo:400:kworker.0 Request processed in 38us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759011.163623:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787759011.163636:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787759011.163642:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995627648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759011.163669:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995627648:12345-0@lo:400:kworker.0 Request processed in 27us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759011.163674:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787759011.163694:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995628160 00000100:00100000:2.0:1787759011.163697:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995628160 00000100:00100000:2.0:1787759011.163720:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787759011.163727:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995628160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759011.163757:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995628160:12345-0@lo:400:kworker.0 Request processed in 30us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759011.163763:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787759011.163781:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787759011.163784:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787759011.163803:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995627648:0@lo:400:kworker.0 00010000:00080000:2.0:1787759011.163814:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee72940 x1874600995628160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759011.163823:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995628160:0@lo:400:kworker.0 00000100:00100000:2.0:1787759011.163831:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3443:1874600995628032:0@lo:400:kworker.0 00000100:00100000:3.0:1787759011.167399:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995627520 00000100:00100000:3.0:1787759011.167422:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995627520 00000100:00100000:3.0:1787759011.167581:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787759011.167594:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3443:x1874600995627520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759011.167744:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3443:x1874600995627520:12345-0@lo:400:kworker.0 Request processed in 153us (4417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759011.167753:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787759011.167911:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3443:1874600995627520:0@lo:400:kworker.0 00000100:00100000:0.0:1787759011.175427:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995628416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787759011.175524:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759011.175588:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787759011.175594:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995628288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787759011.175617:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759011.175993:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995628416 00000100:00100000:0.0:1787759011.176005:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995628416 00000100:00100000:0.0:1787759011.176060:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995628288 00000100:00100000:0.0:1787759011.176062:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995628288 00000100:00100000:0.0:1787759011.176092:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787759011.176103:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995628416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787759011.176141:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1787759011.176209:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995628416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759011.176217:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787759011.176236:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787759011.176242:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995628288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787759011.176259:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1787759011.176285:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995628288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759011.176291:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787759011.176357:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee9d680 x1874600995628288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759011.176392:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995628288:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787759011.176406:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee9e580 x1874600995628416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759011.176416:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995628416:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787759011.227801:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759012.251423:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759012.513728:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787759012.513879:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787759012.514607:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972526080 00000100:00100000:3.0:1787759012.514621:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972526080 00000100:00100000:3.0:1787759012.514703:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 205 00000100:00100000:3.0:1787759012.514713:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972526080:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1787759012.514794:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972526080:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 83us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759012.514801:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 205 00000100:00100000:0.0:1787759012.515749:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972526208 00000100:00100000:0.0:1787759012.515761:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972526208 00000100:00100000:0.0:1787759012.515881:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 58 00000100:00100000:0.0:1787759012.515891:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2365:x1874600972526208:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1787759012.515964:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2365:x1874600972526208:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 76us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759012.515970:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 58 00000100:00080000:2.0:1787759012.516072:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787759013.275287:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787759013.779973:0:9806:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.104 00010000:00010000:2.0:1787759014.298604:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759015.324391:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787759015.845834:0:9854:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-compr ============----- Wed Aug 26 11:43:34 EDT 2026 00000100:00100000:1.0:1787759016.282058:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787759016.282096:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995628544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787759016.282174:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759016.282511:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787759016.282522:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995628672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787759016.282568:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759016.282660:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995629056:0@lo:400:kworker.0 00000100:00100000:2.0:1787759016.282688:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759016.282719:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787759016.282725:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3443:1874600995629184:0@lo:400:kworker.0 00000100:00100000:2.0:1787759016.282749:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759016.282790:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995629056 00000100:00100000:2.0:1787759016.282992:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995629056 00000100:00100000:2.0:1787759016.283045:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995629184 00000100:00100000:2.0:1787759016.283049:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995629184 00000100:00100000:2.0:1787759016.283074:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787759016.283095:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995629056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759016.283152:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995629056:12345-0@lo:400:kworker.0 Request processed in 59us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759016.283159:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787759016.283176:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787759016.283182:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1874600995629184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759016.283209:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1874600995629184:12345-0@lo:400:kworker.0 Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759016.283214:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787759016.283249:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787759016.283284:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3443:1874600995629184:0@lo:400:kworker.0 00000100:00100000:2.0:1787759016.283294:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995629056:0@lo:400:kworker.0 00000100:00100000:3.0:1787759016.283677:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995628544 00000100:00100000:3.0:1787759016.283682:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995628544 00000100:00100000:3.0:1787759016.283736:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995628672 00000100:00100000:3.0:1787759016.283739:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995628672 00000100:00100000:3.0:1787759016.283753:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787759016.283770:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995628544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787759016.283792:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787759016.283830:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995628544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759016.283868:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787759016.283883:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787759016.283889:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995628672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787759016.283906:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787759016.283939:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995628672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759016.283945:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787759016.283976:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee721c0 x1874600995628672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759016.283994:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995628672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787759016.284236:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995628800:0@lo:400:kworker.0 00000100:00100000:1.0:1787759016.284274:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759016.284315:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787759016.284322:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995628928:0@lo:400:kworker.0 00000100:00100000:1.0:1787759016.284346:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787759016.284383:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee9e580 x1874600995628544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759016.284397:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995628544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787759016.284416:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995628928 00000100:00100000:1.0:1787759016.284419:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995628928 00000100:00100000:1.0:1787759016.284447:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787759016.284462:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fedc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995628928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759016.284515:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fedc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995628928:12345-0@lo:400:kworker.0 Request processed in 55us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759016.284523:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787759016.284552:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995628928:0@lo:400:kworker.0 00000100:00100000:3.0:1787759016.285550:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995628800 00000100:00100000:3.0:1787759016.285568:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995628800 00000100:00100000:3.0:1787759016.285628:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787759016.285637:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995628800:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787759016.286043:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787759016.286049:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787759016.286187:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995628800:12345-0@lo:400:kworker.0 Request processed in 550us (1910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759016.286195:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787759016.286331:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995628800:0@lo:400:kworker.0 00010000:00010000:0.0:1787759016.346209:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759017.371098:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759017.637429:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787759017.637466:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787759017.637493:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972526336 00000100:00100000:2.0:1787759017.637501:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972526336 00000100:00100000:2.0:1787759017.637565:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 207 00000100:00100000:2.0:1787759017.637576:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972526336:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1787759017.637642:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972526336:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 68us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759017.637649:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 207 00000100:00100000:2.0:1787759017.637681:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972526464 00000100:00100000:2.0:1787759017.637684:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972526464 00000100:00100000:2.0:1787759017.637720:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 62 00000100:00100000:2.0:1787759017.637726:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972526464:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1787759017.637754:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972526464:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 29us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759017.637760:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 62 00000100:00080000:2.0:1787759017.638069:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787759018.401759:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759019.419200:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759020.442178:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759021.402098:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787759021.402130:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995629312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787759021.402199:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759021.402412:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995629312 00000100:00100000:3.0:1787759021.402418:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995629312 00000100:00100000:3.0:1787759021.402479:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787759021.402487:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995629312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787759021.402513:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787759021.402549:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995629312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759021.402556:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787759021.402575:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995629568:0@lo:400:kworker.0 00000100:00100000:3.0:1787759021.402608:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759021.402625:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787759021.402630:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995629696:0@lo:400:kworker.0 00000100:00100000:3.0:1787759021.402648:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787759021.402667:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787759021.402682:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995629568 00000100:00100000:3.0:1787759021.402686:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995629568 00000100:00100000:3.0:1787759021.402712:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995629696 00000100:00100000:3.0:1787759021.402715:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995629696 00000100:00100000:3.0:1787759021.402735:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787759021.402741:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995629568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759021.402774:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995629568:12345-0@lo:400:kworker.0 Request processed in 34us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759021.402781:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787759021.402793:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787759021.402799:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995629696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759021.402824:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995629696:12345-0@lo:400:kworker.0 Request processed in 26us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759021.402867:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787759021.402884:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787759021.403215:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995629696:0@lo:400:kworker.0 00000100:00100000:3.0:1787759021.403231:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995629568:0@lo:400:kworker.0 00000100:00100000:2.0:1787759021.403322:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995629440:0@lo:400:kworker.0 00000100:00100000:2.0:1787759021.403358:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759021.403391:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995629952:0@lo:400:kworker.0 00000100:00100000:2.0:1787759021.403412:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787759021.403444:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee70b40 x1874600995629312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759021.403460:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995629312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787759021.403471:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787759021.403476:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3442:1874600995629824:0@lo:400:kworker.0 00000100:00100000:2.0:1787759021.403496:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759021.403518:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995629440 00000100:00100000:2.0:1787759021.403522:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995629440 00000100:00100000:2.0:1787759021.403546:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787759021.403552:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3442:x1874600995629440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759021.403580:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3442:x1874600995629440:12345-0@lo:400:kworker.0 Request processed in 28us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759021.403586:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787759021.403751:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995629952 00000100:00100000:2.0:1787759021.403755:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995629952 00000100:00100000:2.0:1787759021.403786:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787759021.403793:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995629952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759021.403825:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995629952:12345-0@lo:400:kworker.0 Request processed in 33us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759021.403832:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787759021.403875:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995629824 00000100:00100000:2.0:1787759021.403879:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995629824 00000100:00100000:2.0:1787759021.403900:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787759021.403993:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1874600995629824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759021.404024:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1874600995629824:12345-0@lo:400:kworker.0 Request processed in 46us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759021.404030:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787759021.404056:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3442:1874600995629824:0@lo:400:kworker.0 00000100:00100000:2.0:1787759021.404065:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995629440:0@lo:400:kworker.0 00010000:00080000:2.0:1787759021.404074:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee71e00 x1874600995629952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759021.404084:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995629952:0@lo:400:kworker.0 00000100:00100000:1.0:1787759021.404274:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787759021.404282:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995630080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787759021.404321:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759021.404350:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995630080 00000100:00100000:1.0:1787759021.404353:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995630080 00000100:00100000:1.0:1787759021.404376:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787759021.404391:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995630080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787759021.404409:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787759021.404533:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995630080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759021.404540:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787759021.404565:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe6cbc00 x1874600995630080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759021.404578:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe6cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995630080:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787759021.405134:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787759021.405139:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787759021.467248:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759022.492250:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759022.754625:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787759022.754812:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972526592 00000100:00100000:2.0:1787759022.754826:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972526592 00000100:00100000:2.0:1787759022.754934:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 209 00000100:00100000:2.0:1787759022.754947:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2362:x1874600972526592:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1787759022.755071:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2362:x1874600972526592:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 127us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759022.755080:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 209 00000100:00100000:3.0:1787759022.756554:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787759022.757766:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972526720 00000100:00100000:2.0:1787759022.757782:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972526720 00000100:00100000:2.0:1787759022.757933:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 66 00000100:00100000:2.0:1787759022.757946:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2362:x1874600972526720:12345-192.168.204.33@tcp:400:kworker.0 00000100:00080000:3.0:1787759022.758169:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787759022.758216:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2362:x1874600972526720:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 265us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759022.758229:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 66 00010000:00010000:3.0:1787759023.514474:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759024.538482:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759025.562337:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759026.524001:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787759026.524033:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995630208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787759026.524155:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995630336:0@lo:400:kworker.0 00000100:00100000:0.0:1787759026.524203:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759026.524262:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3441:1874600995630848:0@lo:400:kworker.0 00000100:00100000:0.0:1787759026.524291:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759026.524314:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787759026.524337:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995630464:0@lo:400:kworker.0 00000100:00100000:0.0:1787759026.524362:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759026.524381:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995630976:0@lo:400:kworker.0 00000100:00100000:2.0:1787759026.525535:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759026.525611:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995630592:0@lo:400:kworker.0 00000100:00100000:0.0:1787759026.525873:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759026.525932:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759026.525945:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995630336 00000100:00100000:0.0:1787759026.525952:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995630336 00000100:00100000:0.0:1787759026.526000:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787759026.526009:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995630336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759026.529015:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995630208 00000100:00100000:3.0:1787759026.529038:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995630208 00000100:00100000:3.0:1787759026.529138:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787759026.529150:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febeed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995630208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787759026.529195:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1787759026.529282:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995630336:12345-0@lo:400:kworker.0 Request processed in 3264us (5068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759026.529303:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febeed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995630208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (3772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759026.529315:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787759026.529352:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995630720:0@lo:400:kworker.0 00000100:00100000:0.0:1787759026.529367:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787759026.529406:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759026.529449:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995630848 00000100:00100000:3.0:1787759026.529453:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787759026.529459:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995630848 00000100:00100000:3.0:1787759026.529464:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995631104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787759026.529573:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787759026.529604:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787759026.529691:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787759026.529707:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995630976 00000100:00100000:3.0:1787759026.529712:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995630976 00000100:00100000:3.0:1787759026.529761:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995630720 00000100:00100000:3.0:1787759026.529764:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995630720 00000100:00100000:3.0:1787759026.529784:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787759026.529795:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995630976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759026.529827:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995630464 00000100:00100000:0.0:1787759026.529834:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995630464 00000100:00100000:0.0:1787759026.529896:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995630592 00000100:00100000:0.0:1787759026.529900:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995630592 00000100:00100000:0.0:1787759026.529920:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787759026.529928:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1874600995630848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759026.530912:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995630976:12345-0@lo:400:kworker.0 Request processed in 1114us (5031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759026.530924:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787759026.530950:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787759026.530963:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995630720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759026.531020:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995630720:12345-0@lo:400:kworker.0 Request processed in 64us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759026.531027:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787759026.531048:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787759026.531054:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787759026.531088:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee9e940 x1874600995630720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759026.531105:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995630720:0@lo:400:kworker.0 00000100:00100000:3.0:1787759026.531136:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995631104 00000100:00100000:3.0:1787759026.531141:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995631104 00000100:00100000:3.0:1787759026.531165:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787759026.531171:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995631104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787759026.531195:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787759026.531229:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995631104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759026.531252:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787759026.531276:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe7cf480 x1874600995631104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759026.531294:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995631104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787759026.532334:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787759026.532354:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995630464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759026.532583:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995630464:12345-0@lo:400:kworker.0 Request processed in 237us (8218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759026.532591:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787759026.532614:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787759026.532622:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febeda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995630592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759026.532655:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febeda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995630592:12345-0@lo:400:kworker.0 Request processed in 35us (6723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759026.532662:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787759026.536484:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1874600995630848:12345-0@lo:400:kworker.0 Request processed in 6547us (12183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759026.536500:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787759026.536697:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995630464:0@lo:400:kworker.0 00010000:00080000:0.0:1787759026.536715:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee9f0c0 x1874600995630976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759026.536727:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995630976:0@lo:400:kworker.0 00000100:00100000:0.0:1787759026.536760:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995630336:0@lo:400:kworker.0 00000100:00100000:0.0:1787759026.536772:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3441:1874600995630848:0@lo:400:kworker.0 00000100:00100000:2.0:1787759026.537270:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995630592:0@lo:400:kworker.0 00010000:00080000:2.0:1787759026.537286:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee70f00 x1874600995630208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759026.537305:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995630208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787759026.590958:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759027.612108:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759027.875256:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787759027.875308:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787759027.875395:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972526848 00000100:00100000:2.0:1787759027.875405:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972526848 00000100:00100000:2.0:1787759027.875468:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 211 00000100:00100000:2.0:1787759027.875488:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2362:x1874600972526848:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1787759027.875563:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2362:x1874600972526848:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 78us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759027.875571:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 211 00000100:00100000:3.0:1787759027.876631:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972526976 00000100:00100000:3.0:1787759027.876641:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972526976 00000100:00100000:3.0:1787759027.876705:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 70 00000100:00100000:3.0:1787759027.876714:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2363:x1874600972526976:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1787759027.876768:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2363:x1874600972526976:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 56us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759027.876776:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 70 00000100:00080000:2.0:1787759027.877082:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787759028.644463:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759029.661411:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759030.689131:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759031.642298:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787759031.642321:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995631232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787759031.642857:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759031.643011:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995631232 00000100:00100000:3.0:1787759031.643028:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995631232 00000100:00100000:3.0:1787759031.643087:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787759031.643097:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995631232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787759031.643197:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787759031.643477:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995631360:0@lo:400:kworker.0 00000100:00100000:1.0:1787759031.643512:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759031.643546:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3441:1874600995631872:0@lo:400:kworker.0 00000100:00100000:1.0:1787759031.643581:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759031.643603:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787759031.643610:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995631488:0@lo:400:kworker.0 00000100:00100000:1.0:1787759031.643633:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759031.643663:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995631872 00000100:00100000:1.0:1787759031.643667:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995631872 00000100:00100000:1.0:1787759031.643700:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995631488 00000100:00100000:1.0:1787759031.643703:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995631488 00000100:00100000:1.0:1787759031.643726:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787759031.643735:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1874600995631872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759031.643775:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1874600995631872:12345-0@lo:400:kworker.0 Request processed in 42us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759031.643794:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787759031.643811:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787759031.643818:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995631488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759031.643871:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995631488:12345-0@lo:400:kworker.0 Request processed in 54us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759031.643878:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787759031.644007:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995631616:0@lo:400:kworker.0 00000100:00100000:1.0:1787759031.644082:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995631488:0@lo:400:kworker.0 00000100:00100000:0.0:1787759031.644121:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759031.644152:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787759031.644158:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995631744:0@lo:400:kworker.0 00000100:00100000:0.0:1787759031.644183:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759031.644213:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995631360 00000100:00100000:0.0:1787759031.644217:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995631360 00000100:00100000:0.0:1787759031.644256:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787759031.644264:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995631360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759031.644292:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995631360:12345-0@lo:400:kworker.0 Request processed in 30us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759031.644299:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787759031.644925:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995631616 00000100:00100000:0.0:1787759031.644931:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995631616 00000100:00100000:0.0:1787759031.644964:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787759031.644972:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995631616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759031.645021:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995631616:12345-0@lo:400:kworker.0 Request processed in 50us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759031.645028:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787759031.645060:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995631616:0@lo:400:kworker.0 00000100:00100000:3.0:1787759031.645503:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995631232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2407us (3105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759031.645514:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787759031.645549:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787759031.645554:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787759031.645606:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995631744 00000100:00100000:3.0:1787759031.645611:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995631744 00000100:00100000:3.0:1787759031.645643:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787759031.645649:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995631744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759031.645686:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995631744:12345-0@lo:400:kworker.0 Request processed in 37us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759031.645692:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787759031.645710:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995632000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787759031.645739:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787759031.645766:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787759031.645792:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995632000 00000100:00100000:3.0:1787759031.645796:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995632000 00000100:00100000:3.0:1787759031.645817:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787759031.645824:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995632000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787759031.645860:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787759031.645893:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995632000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759031.645899:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787759031.645952:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee72940 x1874600995632000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759031.645968:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995632000:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787759031.646116:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe7cd680 x1874600995631232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759031.646131:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995631232:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787759031.646148:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe7cf840 x1874600995631744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759031.646157:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995631744:0@lo:400:kworker.0 00000100:00100000:1.0:1787759031.647860:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3441:1874600995631872:0@lo:400:kworker.0 00000100:00100000:1.0:1787759031.647894:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995631360:0@lo:400:kworker.0 00010000:00010000:1.0:1787759031.705991:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759032.730930:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759033.004234:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787759033.004301:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787759033.004895:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972527104 00000100:00100000:3.0:1787759033.004909:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972527104 00000100:00100000:3.0:1787759033.004974:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 213 00000100:00100000:3.0:1787759033.004985:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2365:x1874600972527104:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1787759033.005071:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2365:x1874600972527104:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 88us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759033.005079:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 213 00000100:00100000:2.0:1787759033.007511:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972527232 00000100:00100000:2.0:1787759033.007537:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972527232 00000100:00100000:2.0:1787759033.007650:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 74 00000100:00100000:2.0:1787759033.007662:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2365:x1874600972527232:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1787759033.007773:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2365:x1874600972527232:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 113us (3553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759033.007780:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 74 00000100:00080000:3.0:1787759033.010994:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787759033.755046:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787759033.951587:0:10582:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 00010000:00010000:1.0:1787759034.780032:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759035.801946:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787759036.162019:0:10630:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-compr: start setup 11:43:54 (1787759034) === 00000100:00100000:0.0:1787759036.762128:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995632128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787759036.762214:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759036.762415:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995632128 00000100:00100000:3.0:1787759036.762423:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995632128 00000100:00100000:3.0:1787759036.762491:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787759036.762504:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995632128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787759036.762539:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787759036.762588:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995632128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759036.762596:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787759036.762862:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787759036.762895:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee70f00 x1874600995632128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759036.762915:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995632128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787759036.766570:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995632256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787759036.766643:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759036.766814:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995632256 00000100:00100000:3.0:1787759036.766822:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995632256 00000100:00100000:3.0:1787759036.766899:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787759036.766908:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995632256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787759036.766938:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787759036.766982:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995632256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759036.766995:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787759036.767274:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787759036.767315:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2febef0c0 x1874600995632256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759036.767334:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995632256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787759036.767538:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3444:1874600995632768:0@lo:400:kworker.0 00000100:00100000:2.0:1787759036.767576:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759036.767601:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787759036.767606:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2e36da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3444:1874600995632640:0@lo:400:kworker.0 00000100:00100000:2.0:1787759036.767628:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759036.767654:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995632768 00000100:00100000:2.0:1787759036.767659:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995632768 00000100:00100000:2.0:1787759036.767719:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995632640 00000100:00100000:2.0:1787759036.767723:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995632640 00000100:00100000:2.0:1787759036.767745:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787759036.767752:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe669a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1874600995632768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759036.767789:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe669a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1874600995632768:12345-0@lo:400:kworker.0 Request processed in 37us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759036.767984:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787759036.768000:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787759036.768006:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe6683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1874600995632640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759036.768035:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe6683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1874600995632640:12345-0@lo:400:kworker.0 Request processed in 30us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759036.768041:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1787759036.768062:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787759036.768081:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2e36da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3444:1874600995632640:0@lo:400:kworker.0 00000100:00100000:2.0:1787759036.768091:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3444:1874600995632768:0@lo:400:kworker.0 00000100:00100000:3.0:1787759036.768219:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3442:1874600995632512:0@lo:400:kworker.0 00000100:00100000:3.0:1787759036.768248:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759036.768274:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787759036.768280:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2febee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995632384:0@lo:400:kworker.0 00000100:00100000:3.0:1787759036.768425:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759036.768506:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995632384 00000100:00100000:0.0:1787759036.768511:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995632384 00000100:00100000:0.0:1787759036.768548:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787759036.768556:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3442:x1874600995632384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759036.768596:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3442:x1874600995632384:12345-0@lo:400:kworker.0 Request processed in 41us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759036.768613:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787759036.768648:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995632384:0@lo:400:kworker.0 00000100:00100000:2.0:1787759036.771442:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995632512 00000100:00100000:2.0:1787759036.771458:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995632512 00000100:00100000:2.0:1787759036.771538:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787759036.771549:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1874600995632512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759036.771647:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1874600995632512:12345-0@lo:400:kworker.0 Request processed in 100us (3396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759036.771668:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787759036.771775:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2febef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3442:1874600995632512:0@lo:400:kworker.0 00010000:00010000:3.0:1787759036.826427:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759037.850040:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759038.111625:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787759038.113070:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972527360 00000100:00100000:0.0:1787759038.113082:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972527360 00000100:00100000:0.0:1787759038.113146:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 215 00000100:00100000:0.0:1787759038.113156:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972527360:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1787759038.113356:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972527360:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 200us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759038.113365:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 215 00000100:00100000:2.0:1787759038.114917:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787759038.115075:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972527488 00000100:00100000:1.0:1787759038.115083:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972527488 00000100:00100000:1.0:1787759038.115150:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 78 00000100:00100000:1.0:1787759038.115158:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe66a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972527488:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1787759038.115224:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe66a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972527488:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 67us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759038.115231:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 78 00000100:00080000:2.0:1787759038.115771:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787759038.874252:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759039.904678:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759040.923373:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759041.882312:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995632896:0@lo:400:kworker.0 00000100:00100000:3.0:1787759041.882382:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759041.882430:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787759041.882435:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995633024:0@lo:400:kworker.0 00000100:00100000:3.0:1787759041.882458:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759041.882531:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995633152:0@lo:400:kworker.0 00000100:00100000:0.0:1787759041.882601:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787759041.882609:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fef3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995633408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787759041.882638:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759041.882668:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995633408 00000100:00100000:0.0:1787759041.882673:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995633408 00000100:00100000:0.0:1787759041.882725:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787759041.882733:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995633408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787759041.882760:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1787759041.882794:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995633408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759041.882801:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787759041.882817:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787759041.882855:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fef3d2c0 x1874600995633408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759041.882870:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fef3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995633408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787759041.885766:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3442:1874600995633536:0@lo:400:kworker.0 00000100:00100000:2.0:1787759041.887173:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995633280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787759041.888648:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759041.888691:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787759041.888698:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995633664:0@lo:400:kworker.0 00000100:00100000:2.0:1787759041.888747:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759041.888829:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995633024 00000100:00100000:2.0:1787759041.888836:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995633024 00000100:00100000:2.0:1787759041.888890:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787759041.888898:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995633024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759041.888956:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995633024:12345-0@lo:400:kworker.0 Request processed in 58us (6496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759041.888963:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787759041.889284:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995632896 00000100:00100000:2.0:1787759041.889289:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995632896 00000100:00100000:2.0:1787759041.889314:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787759041.889319:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995632896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759041.889350:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995632896:12345-0@lo:400:kworker.0 Request processed in 31us (6968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759041.889355:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787759041.890428:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995633280 00000100:00100000:0.0:1787759041.890435:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995633280 00000100:00100000:0.0:1787759041.890470:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787759041.890476:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995633280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787759041.890497:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1787759041.890537:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995633280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759041.890551:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787759041.890598:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe66b840 x1874600995633280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759041.890616:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995633280:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787759041.890644:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787759041.890859:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759041.890899:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759041.890927:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995633152 00000100:00100000:0.0:1787759041.890932:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995633152 00000100:00100000:0.0:1787759041.890958:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995633536 00000100:00100000:0.0:1787759041.890961:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995633536 00000100:00100000:0.0:1787759041.890980:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787759041.890987:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995633152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759041.891033:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995633152:12345-0@lo:400:kworker.0 Request processed in 47us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759041.891303:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787759041.891313:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1874600995633536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759041.891346:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1874600995633536:12345-0@lo:400:kworker.0 Request processed in 36us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759041.891351:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787759041.891390:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1787759041.891407:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787759041.891423:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995633152:0@lo:400:kworker.0 00000100:00100000:0.0:1787759041.891455:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3442:1874600995633536:0@lo:400:kworker.0 00000100:00100000:2.0:1787759041.891604:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995633024:0@lo:400:kworker.0 00000100:00100000:2.0:1787759041.891615:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995632896:0@lo:400:kworker.0 00000100:00100000:1.0:1787759041.896900:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995633664 00000100:00100000:1.0:1787759041.896915:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995633664 00000100:00100000:1.0:1787759041.896982:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787759041.896993:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995633664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759041.897101:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995633664:12345-0@lo:400:kworker.0 Request processed in 110us (8353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759041.897388:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787759041.897519:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe7cf840 x1874600995633664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759041.897535:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995633664:0@lo:400:kworker.0 00010000:00010000:3.0:1787759041.947656:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787759042.510457:0:10823:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787759042.972980:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759043.232739:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787759043.232904:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972527744 00000100:00100000:3.0:1787759043.232916:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972527744 00000100:00100000:3.0:1787759043.233030:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 82 00000100:00100000:3.0:1787759043.233044:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2365:x1874600972527744:12345-192.168.204.33@tcp:400:kworker.0 00000100:00080000:1.0:1787759043.233134:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787759043.239655:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2365:x1874600972527744:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 6590us (6907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759043.239675:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 82 00000100:00100000:0.0:1787759043.240626:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787759043.240948:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972527616 00000100:00100000:1.0:1787759043.240961:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972527616 00000100:00100000:1.0:1787759043.241051:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 217 00000100:00100000:1.0:1787759043.241063:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2365:x1874600972527616:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1787759043.252219:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2365:x1874600972527616:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 11139us (11580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759043.252264:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 217 00010000:00010000:1.0:1787759043.995289:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759045.021097:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759046.045624:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759047.008622:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995633792:0@lo:400:kworker.0 00000100:00100000:2.0:1787759047.008728:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759047.008787:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3444:1874600995634304:0@lo:400:kworker.0 00000100:00100000:2.0:1787759047.008818:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759047.008881:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787759047.008888:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995634176:0@lo:400:kworker.0 00000100:00100000:2.0:1787759047.008917:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759047.008953:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995633920:0@lo:400:kworker.0 00000100:00100000:2.0:1787759047.008981:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759047.009000:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995634432:0@lo:400:kworker.0 00000100:00100000:2.0:1787759047.009023:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759047.009042:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787759047.009048:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3441:1874600995634048:0@lo:400:kworker.0 00000100:00100000:2.0:1787759047.009070:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759047.009111:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995633792 00000100:00100000:2.0:1787759047.009119:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995633792 00000100:00100000:2.0:1787759047.009183:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787759047.009525:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3444:x1874600995633792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759047.009601:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3444:x1874600995633792:12345-0@lo:400:kworker.0 Request processed in 408us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759047.009609:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787759047.009654:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995634304 00000100:00100000:2.0:1787759047.009659:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995634304 00000100:00100000:2.0:1787759047.009707:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995633920 00000100:00100000:2.0:1787759047.009710:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995633920 00000100:00100000:2.0:1787759047.009724:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995634048 00000100:00100000:2.0:1787759047.009744:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995634048 00000100:00100000:2.0:1787759047.009763:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787759047.009769:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1874600995634304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759047.009801:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1874600995634304:12345-0@lo:400:kworker.0 Request processed in 33us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759047.009807:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787759047.009816:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787759047.009821:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995633920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759047.009881:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995633920:12345-0@lo:400:kworker.0 Request processed in 59us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759047.009887:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787759047.009897:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787759047.009903:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1874600995634048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759047.009930:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1874600995634048:12345-0@lo:400:kworker.0 Request processed in 28us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759047.009936:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787759047.009964:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995634176 00000100:00100000:2.0:1787759047.009967:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995634176 00000100:00100000:2.0:1787759047.010000:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995634432 00000100:00100000:2.0:1787759047.010003:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995634432 00000100:00100000:2.0:1787759047.010029:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787759047.010040:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995634176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759047.010076:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995634176:12345-0@lo:400:kworker.0 Request processed in 38us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759047.010085:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787759047.010100:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787759047.010107:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995634432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759047.010152:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995634432:12345-0@lo:400:kworker.0 Request processed in 47us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759047.010160:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787759047.011633:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995634688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787759047.011707:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759047.012551:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995634688 00000100:00100000:1.0:1787759047.012578:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995634688 00000100:00100000:1.0:1787759047.012639:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787759047.012648:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995634688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787759047.012679:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787759047.012866:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995634688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 191us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759047.012875:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787759047.012921:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe7cd2c0 x1874600995634688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759047.012942:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995634688:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787759047.015634:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787759047.015649:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787759047.015654:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787759047.015695:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fef3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995634560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787759047.016431:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759047.016578:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3441:1874600995634048:0@lo:400:kworker.0 00000100:00100000:1.0:1787759047.016601:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995633920:0@lo:400:kworker.0 00010000:00080000:1.0:1787759047.016619:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe7fc780 x1874600995634432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759047.016655:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995634432:0@lo:400:kworker.0 00010000:00080000:1.0:1787759047.016700:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe7fc3c0 x1874600995634176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759047.016709:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995634176:0@lo:400:kworker.0 00000100:00100000:1.0:1787759047.016735:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995633792:0@lo:400:kworker.0 00000100:00100000:1.0:1787759047.016752:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3444:1874600995634304:0@lo:400:kworker.0 00000100:00100000:0.0:1787759047.017540:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995634560 00000100:00100000:0.0:1787759047.017556:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995634560 00000100:00100000:0.0:1787759047.017628:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787759047.017640:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995634560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787759047.017684:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1787759047.017789:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1874600995634560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759047.017797:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787759047.019548:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fef3e1c0 x1874600995634560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759047.019582:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fef3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995634560:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787759047.067013:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759048.092563:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759048.355442:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787759048.355492:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787759048.355596:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972527872 00000100:00100000:2.0:1787759048.355606:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972527872 00000100:00100000:2.0:1787759048.355671:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 219 00000100:00100000:2.0:1787759048.355680:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972527872:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1787759048.355766:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972527872:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 87us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759048.355774:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 219 00000100:00100000:2.0:1787759048.355805:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972528000 00000100:00100000:2.0:1787759048.355810:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972528000 00000100:00100000:2.0:1787759048.355863:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 86 00000100:00100000:2.0:1787759048.355870:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972528000:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1787759048.355900:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972528000:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 30us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759048.355905:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 86 00000100:00080000:2.0:1787759048.357247:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787759049.114293:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759050.138077:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787759050.666467:0:11085:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787759050.666771:0:11085:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787759051.163545:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759052.122551:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995634944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787759052.122712:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995634816:0@lo:400:kworker.0 00000100:00100000:3.0:1787759052.122806:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759052.122900:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3441:1874600995635456:0@lo:400:kworker.0 00000100:00100000:3.0:1787759052.122929:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759052.122961:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787759052.122966:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995635072:0@lo:400:kworker.0 00000100:00100000:3.0:1787759052.122988:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759052.123016:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995635584:0@lo:400:kworker.0 00000100:00100000:3.0:1787759052.123078:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759052.123130:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995634816 00000100:00100000:2.0:1787759052.123696:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759052.123734:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995635328:0@lo:400:kworker.0 00000100:00100000:2.0:1787759052.123759:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759052.123778:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787759052.123784:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fee9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3444:1874600995635200:0@lo:400:kworker.0 00000100:00100000:2.0:1787759052.123807:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759052.123836:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fef3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995635712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787759052.123879:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759052.123918:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995635584 00000100:00100000:2.0:1787759052.123923:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995635584 00000100:00100000:2.0:1787759052.123987:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995635328 00000100:00100000:2.0:1787759052.123990:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995635328 00000100:00100000:2.0:1787759052.124034:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787759052.124044:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe2312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995635584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759052.124109:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe2312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995635584:12345-0@lo:400:kworker.0 Request processed in 66us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759052.124118:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787759052.124136:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787759052.125158:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995634944 00000100:00100000:0.0:1787759052.125172:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995634944 00000100:00100000:0.0:1787759052.125210:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995635712 00000100:00100000:0.0:1787759052.125213:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995635712 00000100:00100000:0.0:1787759052.125229:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787759052.125239:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995634944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787759052.125290:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1787759052.125776:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995634944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 538us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759052.125786:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787759052.125806:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787759052.125813:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1874600995635712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787759052.125873:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1787759052.125906:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1874600995635712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759052.125912:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787759052.126242:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995634816 00000100:00100000:3.0:1787759052.126665:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787759052.126676:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995634816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759052.126728:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3441:x1874600995634816:12345-0@lo:400:kworker.0 Request processed in 56us (3923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759052.126735:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787759052.126778:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995635456 00000100:00100000:3.0:1787759052.126800:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995635456 00000100:00100000:3.0:1787759052.126865:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995635072 00000100:00100000:3.0:1787759052.126869:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995635072 00000100:00100000:3.0:1787759052.126886:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995635200 00000100:00100000:3.0:1787759052.126888:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995635200 00000100:00100000:3.0:1787759052.126904:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787759052.126910:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fee9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1874600995635456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759052.126946:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fee9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1874600995635456:12345-0@lo:400:kworker.0 Request processed in 36us (4016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759052.126952:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787759052.126964:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787759052.126970:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995635072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759052.126996:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1874600995635072:12345-0@lo:400:kworker.0 Request processed in 26us (4007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759052.127012:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787759052.127024:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787759052.127030:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1874600995635200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759052.127071:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1874600995635200:12345-0@lo:400:kworker.0 Request processed in 31us (3252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759052.127077:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787759052.127557:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995635328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759052.127677:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995635328:12345-0@lo:400:kworker.0 Request processed in 376us (3916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759052.128785:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3441:1874600995635072:0@lo:400:kworker.0 00010000:00080000:3.0:1787759052.128812:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee9e580 x1874600995635584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759052.128826:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995635584:0@lo:400:kworker.0 00000100:00100000:3.0:1787759052.128864:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995634816:0@lo:400:kworker.0 00000100:00100000:3.0:1787759052.128897:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3441:1874600995635456:0@lo:400:kworker.0 00000100:00100000:0.0:1787759052.131358:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3444:1874600995635200:0@lo:400:kworker.0 00010000:00080000:0.0:1787759052.131396:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fef3e940 x1874600995635712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759052.131422:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fef3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995635712:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787759052.131434:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fee9d680 x1874600995635328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759052.131443:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fee9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995635328:0@lo:400:kworker.0 00010000:00080000:0.0:1787759052.131456:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe7ff480 x1874600995634944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759052.131468:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995634944:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787759052.131938:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787759052.131947:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787759052.131950:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787759052.132670:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1787759052.186090:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787759052.826362:0:11182:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787759052.826737:0:11182:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787759053.216131:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759053.471462:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787759053.471538:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787759053.471672:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972528128 00000100:00100000:1.0:1787759053.471685:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972528128 00000100:00100000:1.0:1787759053.471773:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 221 00000100:00100000:3.0:1787759053.471774:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972528256 00000100:00100000:1.0:1787759053.471789:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972528128:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1787759053.471791:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972528256 00000100:00100000:1.0:1787759053.471937:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2364:x1874600972528128:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 152us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759053.471946:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 221 00000100:00100000:3.0:1787759053.472303:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 90 00000100:00100000:3.0:1787759053.472319:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2365:x1874600972528256:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1787759053.472440:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2365:x1874600972528256:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 123us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759053.472450:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 90 00000100:00080000:3.0:1787759053.472490:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787759054.244484:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759055.260054:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787759055.281702:0:11280:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787759055.281968:0:11280:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787759056.288697:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759057.242039:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fef3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995635840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787759057.242113:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759057.242200:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995635968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787759057.242232:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759057.242306:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995635840 00000100:00100000:1.0:1787759057.242313:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995635840 00000100:00100000:0.0:1787759057.242341:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995635968 00000100:00100000:0.0:1787759057.242345:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995635968 00000100:00100000:0.0:1787759057.242439:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787759057.242448:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995635968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787759057.242479:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787759057.242784:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe231680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995636224:0@lo:400:kworker.0 00000100:00100000:3.0:1787759057.242872:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759057.242921:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995636224 00000100:00100000:3.0:1787759057.242925:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995636224 00000100:00100000:3.0:1787759057.242956:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787759057.242963:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe232580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995636224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759057.243004:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe232580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995636224:12345-0@lo:400:kworker.0 Request processed in 40us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759057.243012:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787759057.243055:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe231680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995636224:0@lo:400:kworker.0 00000100:00100000:0.0:1787759057.243128:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995635968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 681us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759057.243186:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787759057.243193:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe231680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995636352:0@lo:400:kworker.0 00000100:00100000:3.0:1787759057.243218:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759057.243241:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995636352 00000100:00100000:3.0:1787759057.243245:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995636352 00000100:00100000:3.0:1787759057.243272:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787759057.243289:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe2321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995636352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759057.243336:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe2321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995636352:12345-0@lo:400:kworker.0 Request processed in 58us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759057.243342:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787759057.243366:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe231680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995636352:0@lo:400:kworker.0 00000100:00100000:0.0:1787759057.252008:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787759057.252041:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787759057.252057:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995635840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787759057.252092:0:6943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1787759057.252198:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1874600995635840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (10084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759057.252204:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1787759057.252564:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787759057.252572:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787759057.252574:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787759057.252604:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe233c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995636096:0@lo:400:kworker.0 00000100:00100000:2.0:1787759057.252658:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759057.253232:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787759057.253242:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe231680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3442:1874600995636480:0@lo:400:kworker.0 00000100:00100000:2.0:1787759057.253296:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759057.253334:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995636480 00000100:00100000:2.0:1787759057.253342:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995636480 00000100:00100000:2.0:1787759057.253394:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787759057.253402:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1874600995636480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759057.253451:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1874600995636480:12345-0@lo:400:kworker.0 Request processed in 50us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759057.253458:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787759057.253501:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe231680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3442:1874600995636480:0@lo:400:kworker.0 00010000:00080000:2.0:1787759057.253535:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe7ff0c0 x1874600995635968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759057.253555:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995635968:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787759057.253572:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787759057.253674:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995636096 00000100:00100000:0.0:1787759057.253679:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995636096 00000100:00100000:0.0:1787759057.253706:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787759057.253713:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3442:x1874600995636096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759057.253762:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3442:x1874600995636096:12345-0@lo:400:kworker.0 Request processed in 50us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759057.253769:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00010000:00080000:1.0:1787759057.254344:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fef3f480 x1874600995635840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759057.254362:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fef3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3444:1874600995635840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787759057.254438:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe233c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995636096:0@lo:400:kworker.0 00010000:00010000:0.0:1787759057.311559:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787759057.898969:0:11377:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787759057.899200:0:11377:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787759058.334691:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759058.599112:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787759058.599170:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787759058.599277:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972528512 00000100:00100000:1.0:1787759058.599288:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972528512 00000100:00100000:1.0:1787759058.599372:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 94 00000100:00100000:1.0:1787759058.599383:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2362:x1874600972528512:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:1.0:1787759058.599462:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2362:x1874600972528512:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 81us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759058.599470:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 94 00000100:00080000:0.0:1787759058.599780:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787759058.600096:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972528384 00000100:00100000:3.0:1787759058.600104:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972528384 00000100:00100000:3.0:1787759058.600165:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 223 00000100:00100000:3.0:1787759058.600174:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2362:x1874600972528384:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1787759058.600227:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2362:x1874600972528384:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 54us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759058.600234:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 223 00010000:00010000:0.0:1787759059.357826:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759060.384361:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759061.404063:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787759062.146791:0:11521:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787759062.363619:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995636736:0@lo:400:kworker.0 00000100:00100000:3.0:1787759062.363716:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759062.363783:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe230b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995637248:0@lo:400:kworker.0 00000100:00100000:3.0:1787759062.363813:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759062.363872:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787759062.363879:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe230780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995636864:0@lo:400:kworker.0 00000100:00100000:3.0:1787759062.363925:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759062.363964:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995636736 00000100:00100000:3.0:1787759062.363973:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995636736 00000100:00100000:3.0:1787759062.364030:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995636864 00000100:00100000:3.0:1787759062.364033:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995636864 00000100:00100000:3.0:1787759062.364071:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787759062.364081:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe230f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995636736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759062.364261:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe2303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995636608:0@lo:400:kworker.0 00000100:00100000:1.0:1787759062.364301:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759062.364329:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe232d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3442:1874600995637120:0@lo:400:kworker.0 00000100:00100000:1.0:1787759062.364351:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759062.364363:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787759062.364368:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe231a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995636992:0@lo:400:kworker.0 00000100:00100000:1.0:1787759062.364389:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759062.364423:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995636608 00000100:00100000:1.0:1787759062.364427:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995636608 00000100:00100000:3.0:1787759062.364483:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe230f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1874600995636736:12345-0@lo:400:kworker.0 Request processed in 402us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759062.364493:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787759062.364510:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995637120 00000100:00100000:3.0:1787759062.364513:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995637120 00000100:00100000:3.0:1787759062.364529:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787759062.364535:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995636864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759062.364563:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1874600995636864:12345-0@lo:400:kworker.0 Request processed in 28us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759062.364569:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787759062.364580:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787759062.364585:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1874600995637120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759062.365972:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fef3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995637504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787759062.366033:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759062.366170:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787759062.366197:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3442:x1874600995636608:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787759062.367062:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787759062.367899:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1874600995637120:12345-0@lo:400:kworker.0 Request processed in 3304us (3538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759062.367913:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787759062.368639:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995637248 00000100:00100000:0.0:1787759062.368675:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995637248 00000100:00100000:0.0:1787759062.368751:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995636992 00000100:00100000:0.0:1787759062.368754:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995636992 00000100:00100000:0.0:1787759062.368908:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787759062.368918:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe232940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995637248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759062.369004:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3442:x1874600995636608:12345-0@lo:400:kworker.0 Request processed in 2821us (4698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759062.369015:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787759062.369070:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995637504 00000100:00100000:1.0:1787759062.369081:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995637504 00000100:00100000:1.0:1787759062.369112:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787759062.369119:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1874600995637504:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787759062.369625:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe232940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995637248:12345-0@lo:400:kworker.0 Request processed in 706us (5807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759062.369633:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787759062.369650:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787759062.369657:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3442:x1874600995636992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759062.369695:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3442:x1874600995636992:12345-0@lo:400:kworker.0 Request processed in 40us (5305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759062.369701:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787759062.370357:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787759062.370362:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787759062.370480:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe2303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3442:1874600995636608:0@lo:400:kworker.0 00000100:00100000:3.0:1787759062.370503:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe232d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3442:1874600995637120:0@lo:400:kworker.0 00010000:00080000:3.0:1787759062.370539:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe231a40 x1874600995636992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759062.370570:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe231a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3442:1874600995636992:0@lo:400:kworker.0 00000100:00100000:3.0:1787759062.370604:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe230780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3443:1874600995636864:0@lo:400:kworker.0 00000100:00100000:3.0:1787759062.370620:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3443:1874600995636736:0@lo:400:kworker.0 00010000:00080000:3.0:1787759062.370633:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe230b40 x1874600995637248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1787759062.370643:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787759062.370644:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe230b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995637248:0@lo:400:kworker.0 00000100:00100000:3.0:1787759062.370662:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787759062.370677:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995637376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787759062.370786:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759062.370924:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995637504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1804us (4889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759062.370936:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787759062.370956:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995637376 00000100:00100000:1.0:1787759062.370962:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995637376 00010000:00080000:0.0:1787759062.371115:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fef3e940 x1874600995637504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759062.371134:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fef3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995637504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787759062.375090:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787759062.375134:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe230b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995637376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787759062.375200:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1787759062.375320:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe230b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1874600995637376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 215us (4532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759062.375328:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1787759062.377375:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe7fde00 x1874600995637376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759062.377412:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3443:1874600995637376:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787759062.431272:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759063.452174:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759063.715889:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787759063.716022:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787759063.718587:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972528640 00000100:00100000:3.0:1787759063.718605:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972528640 00000100:00100000:3.0:1787759063.718685:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 225 00000100:00100000:3.0:1787759063.718698:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2363:x1874600972528640:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1787759063.718802:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2363:x1874600972528640:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 106us (2778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759063.718811:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 225 00000100:00100000:2.0:1787759063.726311:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972528768 00000100:00100000:2.0:1787759063.726331:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972528768 00000100:00100000:2.0:1787759063.726444:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 98 00000100:00100000:2.0:1787759063.726457:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2363:x1874600972528768:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:2.0:1787759063.726588:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2363:x1874600972528768:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 132us (10709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759063.726597:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 98 00000100:00080000:3.0:1787759063.726828:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787759064.479569:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759065.499996:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787759066.278267:0:11669:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff33b5c7b0 20000000:00000080:1.0:1787759066.278286:0:11669:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88b2fedf8800 uarg=0000000000000000 20000000:01000000:1.0:1787759066.278450:0:11669:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787759066.278457:0:11669:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787759066.278462:0:11669:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787759066.282149:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787759066.282544:0:11669:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787759066.292702:0:11669:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787759066.292867:0:11669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759066.292889:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2c151e200/0x1a77009127f0522c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334e2 expref: 9 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759066.292914:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2e472a200/0x1a77009127f0523a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05233 expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759066.292920:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2fe4cf200/0x1a77009127f05248 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05241 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759066.292925:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b2c151f400/0x1a77009127f05256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f0524f expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759066.292931:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759066.292974:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2c151f400/0x1a77009127f05256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f0524f expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759066.292989:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2c151f400/0x1a77009127f05256 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f0524f expref: 18 pid: 5947 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759066.293003:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cde00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874600995637632:0@lo:104: 00000100:00100000:1.0:1787759066.293070:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787759066.293153:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2fe4cf200/0x1a77009127f05248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f05241 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759066.293162:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2fe4cf200/0x1a77009127f05248 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f05241 expref: 18 pid: 5946 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759066.293171:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cf840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874600995637760:0@lo:104: 00000100:00100000:1.0:1787759066.293193:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787759066.293216:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2e472a200/0x1a77009127f0523a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a77009127f05233 expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759066.293242:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995637632 00010000:00010000:1.0:1787759066.293244:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b2e472a200/0x1a77009127f0523a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a77009127f05233 expref: 18 pid: 5948 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759066.293250:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995637632 00000100:00100000:1.0:1787759066.293252:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cc780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874600995637888:0@lo:104: 00000100:00100000:1.0:1787759066.293274:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759066.293289:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995637760 00010000:00010000:1.0:1787759066.293292:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b2c151e200/0x1a77009127f0522c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334e2 expref: 9 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759066.293292:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995637760 00010000:00010000:1.0:1787759066.293302:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b2c151e200/0x1a77009127f0522c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334e2 expref: 9 pid: 5946 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759066.293302:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995637888 00000100:00100000:2.0:1787759066.293304:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995637888 00000100:00100000:1.0:1787759066.293312:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874600995638016:192.168.204.33@tcp:104: 00000100:00100000:2.0:1787759066.293316:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787759066.293324:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7cd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+5:11669:x1874600995637632:12345-0@lo:104: 00010000:00010000:2.0:1787759066.293335:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f05256 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759066.293383:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787759066.293390:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7cd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+5:11669:x1874600995637632:12345-0@lo:104: Request processed in 66us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759066.293397:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787759066.293414:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787759066.293421:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+4:11669:x1874600995637760:12345-0@lo:104: 00010000:00010000:2.0:1787759066.293428:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f05248 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759066.293462:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787759066.293467:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+4:11669:x1874600995637760:12345-0@lo:104: Request processed in 48us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759066.293473:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787759066.293484:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787759066.293500:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe7ce580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:11669:x1874600995637888:12345-0@lo:104: 00010000:00010000:2.0:1787759066.293508:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f0523a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759066.293541:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787759066.293545:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe7ce580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+3:11669:x1874600995637888:12345-0@lo:104: Request processed in 47us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759066.293550:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787759066.293696:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787759066.293704:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f05256 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.293711:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c151e600 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:0.0:1787759066.293715:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f05256 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.293734:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f05256 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759066.293741:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f05256 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759066.293746:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787759066.293785:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05256 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.293791:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759066.293811:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05256 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.293819:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c151e600/0x1a77009127f0524f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05256 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.293834:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787759066.293837:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f05248 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.293865:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c151ea00 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:0.0:1787759066.293868:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f05248 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.293875:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f05248 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759066.293882:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f05248 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759066.293893:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787759066.293910:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05248 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.293915:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759066.293930:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05248 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.293937:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2c151ea00/0x1a77009127f05241 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f05248 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.293945:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787759066.293948:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a77009127f0523a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.293953:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2e350ce00 already unused, calling callback (ffffffffc1463c20) 10000000:00010000:0.0:1787759066.293955:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a77009127f0523a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.293961:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a77009127f0523a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759066.293966:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a77009127f0523a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759066.293971:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787759066.293982:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0523a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.293988:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759066.294000:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0523a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.294006:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff88b2e350ce00/0x1a77009127f05233 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a77009127f0523a expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.294018:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759066.294020:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759066.294022:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759066.294153:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759066.294165:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787759066.294180:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fef3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995638144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787759066.294217:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759066.294263:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fef3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995638400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787759066.294288:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759066.294306:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787759066.294312:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fef3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995638272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787759066.294332:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759066.294356:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995638144 00000100:00100000:0.0:1787759066.294361:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995638144 00010000:00010000:0.0:1787759066.294382:0:8884:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2c151f400/0x1a77009127f05256 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f0524f expref: 19 pid: 5947 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759066.294404:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995638400 00000100:00100000:0.0:1787759066.294406:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995638400 00010000:00010000:0.0:1787759066.294417:0:8884:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2e472a200/0x1a77009127f0523a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05233 expref: 20 pid: 5948 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759066.294426:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995638272 00000100:00100000:0.0:1787759066.294429:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995638272 00010000:00010000:0.0:1787759066.294448:0:8884:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2fe4cf200/0x1a77009127f05248 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05241 expref: 21 pid: 5946 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759066.294462:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787759066.294468:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c7277c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+21:3441:x1874600995638144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787759066.294479:0:8884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759066.294484:0:8884:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2c151f400/0x1a77009127f05256 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f0524f expref: 21 pid: 5947 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.294511:0:8884:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2c151f400/0x1a77009127f05256 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f0524f expref: 21 pid: 5947 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.294528:0:8884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759066.294558:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c7277c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+21:3441:x1874600995638144:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759066.294564:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787759066.294608:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787759066.294615:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+20:3444:x1874600995638400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787759066.294622:0:8884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759066.294626:0:8884:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2e472a200/0x1a77009127f0523a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05233 expref: 20 pid: 5948 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.294634:0:8884:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2e472a200/0x1a77009127f0523a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f05233 expref: 20 pid: 5948 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.294644:0:8884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759066.294670:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+20:3444:x1874600995638400:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759066.294676:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787759066.294695:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787759066.294701:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe669680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3444:x1874600995638272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787759066.294708:0:8884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759066.294713:0:8884:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2fe4cf200/0x1a77009127f05248 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a77009127f05241 expref: 19 pid: 5946 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.294722:0:8884:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2fe4cf200/0x1a77009127f05248 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a77009127f05241 expref: 19 pid: 5946 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.294732:0:8884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759066.294754:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe669680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:3444:x1874600995638272:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759066.294760:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787759066.294966:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dde40 going to sleep for 11 seconds 00010000:00010000:1.0:1787759066.294989:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c151f400/0x1a77009127f05256 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f0524f expref: 18 pid: 5947 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759066.295000:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cde00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874600995637632:0@lo:104: 00010000:00010000:1.0:1787759066.295009:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2fe4cf200/0x1a77009127f05248 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f05241 expref: 17 pid: 5946 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759066.295017:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cf840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874600995637760:0@lo:104: 00010000:00010000:1.0:1787759066.295025:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2e472a200/0x1a77009127f0523a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a77009127f05233 expref: 16 pid: 5948 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759066.295033:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cc780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874600995637888:0@lo:104: 00000100:00100000:0.0:1787759066.295509:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fef3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995638272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787759066.295518:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fef3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3444:1874600995638400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787759066.295545:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fef3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:3441:1874600995638144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787759066.297361:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759066.299194:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874600995638016:192.168.204.33@tcp:104: 00010000:00010000:1.0:1787759066.299243:0:11669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759066.299243:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787759066.303012:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972528896 00000100:00100000:0.0:1787759066.303025:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972528896 00010000:00010000:0.0:1787759066.303327:0:8884:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b2c151e200/0x1a77009127f0522c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334e2 expref: 10 pid: 5946 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759066.303375:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 28 00000100:00100000:0.0:1787759066.303386:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe230780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2362:x1874600972528896:12345-192.168.204.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787759066.303403:0:8884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759066.303409:0:8884:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b2c151e200/0x1a77009127f0522c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334e2 expref: 10 pid: 5946 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.303444:0:8884:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b2c151e200/0x1a77009127f0522c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334e2 expref: 10 pid: 5946 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.303464:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2c151e200/0x1a77009127f0522c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334e2 expref: 10 pid: 5946 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.303484:0:8884:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.303492:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.303510:0:8884:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.303517:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.303524:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.303542:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.303548:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2fe4ce800 already unused, calling callback (ffffffffc0e68530) 00010000:00010000:0.0:1787759066.303553:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.303562:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.303595:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.303607:0:8884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759066.303724:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe230780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:2362:x1874600972528896:12345-192.168.204.33@tcp:103:ldlm_bl.0 Request processed in 338us (4690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759066.303732:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 28 00010000:00010000:1.0:1787759066.303761:0:11669:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759066.303770:0:11669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759066.303776:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b2fe4ce800/0x1a77009127f0525d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759066.522911:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787759067.418532:0:5950:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787759067.418539:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b2fe715800 from 7 10000000:01000000:2.0:1787759067.418544:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787759067.418593:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759067.418606:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759067.418617:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759067.418644:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995638528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787759067.419065:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759067.419125:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c963b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787759067.419203:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995638528 00000100:00100000:1.0:1787759067.419211:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995638528 00000100:00100000:1.0:1787759067.420350:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787759067.420364:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+16:5950:x1874600995638528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759067.420380:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759067.420399:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2fe4ce000/0x1a77009127f0526b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f05264 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759067.420426:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2fe4ce000/0x1a77009127f0526b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f05264 expref: 17 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759067.420438:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2fe4ce000/0x1a77009127f0526b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05264 expref: 17 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759067.420447:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2fe4ce000, rc 0) 00000100:00100000:1.0:1787759067.420502:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995638528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759067.420509:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787759067.420559:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995638528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759067.420581:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05264 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0526b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759067.420591:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05264 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f0526b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759067.420660:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995638656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759067.420690:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759067.420810:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995638656 00000100:00100000:0.0:1787759067.420816:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995638656 00000100:00100000:0.0:1787759067.420859:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787759067.420867:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995638656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759067.420975:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995638656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759067.420982:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787759067.421154:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd480 going to sleep for 11 seconds 00000100:00100000:1.0:1787759067.421165:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995638656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759067.421196:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7cda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995638784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759067.421232:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759067.421790:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c92dd480 going to sleep for 11 seconds 00000100:00100000:1.0:1787759067.421808:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995638784 00000100:00100000:1.0:1787759067.421812:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995638784 00000100:00100000:1.0:1787759067.421978:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787759067.421990:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995638784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759067.422096:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+17:5950:x1874600995638784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759067.422143:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7cda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995638784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787759067.428062:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787759067.428294:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787759067.428325:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787759067.428336:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05264 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0526b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759067.428360:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2c151ec00/0x1a77009127f05264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f0526b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759067.428370:0:5950:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787759067.428372:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b301aae000 from 7 10000000:01000000:2.0:1787759067.428375:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787759067.428413:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759067.428420:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759067.428432:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759067.428457:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7ff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995638912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787759067.428529:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759067.428576:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c963bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787759067.430360:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995638912 00000100:00100000:3.0:1787759067.430373:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995638912 00000100:00100000:3.0:1787759067.430420:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787759067.430429:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995638912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787759067.430444:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759067.430461:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e350cc00/0x1a77009127f05279 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f05272 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759067.430485:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e350cc00/0x1a77009127f05279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f05272 expref: 19 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759067.430496:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e350cc00/0x1a77009127f05279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05272 expref: 19 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759067.430505:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e350cc00, rc 0) 00000100:00100000:3.0:1787759067.430615:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995638912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759067.430623:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787759067.432944:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787759067.433296:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7ff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995638912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759067.433324:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05272 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05279 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759067.433336:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05272 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f05279 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759067.433430:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7ff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995639040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759067.433478:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759067.433517:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c963bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787759067.434662:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995639040 00000100:00100000:3.0:1787759067.434672:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995639040 00000100:00100000:3.0:1787759067.434726:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787759067.434737:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995639040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759067.434891:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995639040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759067.434901:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787759067.434920:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7ff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995639040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759067.435009:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7ff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995639168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759067.435048:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759067.435187:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2c963bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787759067.436360:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995639168 00000100:00100000:3.0:1787759067.436368:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995639168 00000100:00100000:3.0:1787759067.436433:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787759067.436441:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995639168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787759067.436550:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995639168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759067.436558:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787759067.440946:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7ff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995639168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787759067.441746:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787759067.441802:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787759067.441825:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787759067.441836:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05279 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759067.441866:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2c151e200/0x1a77009127f05272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05279 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759067.441877:0:5950:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787759067.441880:0:5950:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b2e05c4000 from 7 10000000:01000000:3.0:1787759067.441883:0:5950:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787759067.441919:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f05280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759067.441928:0:5950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f05280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759067.441938:0:5950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f05280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759067.441961:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe232d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995639296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787759067.442019:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759067.442069:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2cf30d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787759067.443913:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995639296 00000100:00100000:0.0:1787759067.443924:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995639296 00000100:00100000:0.0:1787759067.444038:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787759067.444051:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2c77a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+18:5950:x1874600995639296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787759067.444069:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759067.444097:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e472bc00/0x1a77009127f05287 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a77009127f05280 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759067.444129:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e472bc00/0x1a77009127f05287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a77009127f05280 expref: 19 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759067.444146:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e472bc00/0x1a77009127f05287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a77009127f05280 expref: 19 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759067.444165:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e472bc00, rc 0) 00000100:00100000:0.0:1787759067.444316:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2c77a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995639296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759067.444325:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787759067.446387:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe232d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995639296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787759067.446412:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f05280 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05287 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759067.446426:0:5950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f05280 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a77009127f05287 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759067.446507:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995639424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759067.446558:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759067.446665:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787759067.449349:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995639424 00000100:00100000:1.0:1787759067.449363:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995639424 00000100:00100000:1.0:1787759067.449418:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787759067.449428:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995639424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759067.449594:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995639424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (3034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759067.449612:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787759067.450746:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995639424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759067.450798:0:5950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995639552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787759067.451756:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759067.451782:0:5950:0:(client.c:2715:ptlrpc_set_wait()) set ffff88b2e0d15c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787759067.451801:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995639552 00000100:00100000:0.0:1787759067.451807:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995639552 00000100:00100000:0.0:1787759067.451861:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787759067.451870:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995639552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787759067.451980:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb6a7c9f-0533-4587-8019-48dc39f7d1fe+19:5950:x1874600995639552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759067.451996:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787759067.452047:0:5950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb6a7c9f-0533-4587-8019-48dc39f7d1fe:5950:1874600995639552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787759067.461310:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787759067.461540:0:5950:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787759067.461565:0:5950:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787759067.461577:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f05280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05287 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759067.461588:0:5950:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff88b2e350d600/0x1a77009127f05280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a77009127f05287 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759067.482961:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe66b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995639808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787759067.483027:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759067.483091:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe7fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995639680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787759067.483116:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759067.483139:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995639808 00000100:00100000:2.0:1787759067.483147:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995639808 00000100:00100000:2.0:1787759067.483199:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995639680 00000100:00100000:2.0:1787759067.483203:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995639680 00000100:00100000:2.0:1787759067.483226:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787759067.483236:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe66a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995639808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787759067.483264:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1787759067.483322:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe66a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995639808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759067.483331:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787759067.483351:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787759067.483361:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe66b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995639680:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787759067.483374:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe2303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3442:1874600995639936:0@lo:400:kworker.0 00002000:00000024:2.0:1787759067.483377:0:6944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00010000:00080000:0.0:1787759067.483460:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe66b480 x1874600995639808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759067.483480:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe66b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995639808:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787759067.483492:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b2fe7fde00 x1874600995639680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759067.483503:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe7fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3441:1874600995639680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787759067.484256:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3444:1874600995640192:0@lo:400:kworker.0 00000100:00100000:3.0:1787759067.485408:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759067.485459:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe66b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1874600995639680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2097us (2339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759067.485465:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995639936 00000100:00100000:2.0:1787759067.485470:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787759067.485472:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995639936 00000100:00080000:2.0:1787759067.485505:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787759067.485511:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787759067.485517:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787759067.485527:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe233840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1874600995639936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759067.485585:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe233840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1874600995639936:12345-0@lo:400:kworker.0 Request processed in 60us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759067.485592:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787759067.485631:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe2303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3442:1874600995639936:0@lo:400:kworker.0 00000100:00100000:0.0:1787759067.485787:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759067.485886:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787759067.485896:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88b2fe232d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3444:1874600995640064:0@lo:400:kworker.0 00000100:00100000:0.0:1787759067.485930:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759067.487360:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995640192 00000100:00100000:1.0:1787759067.487368:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995640192 00000100:00100000:1.0:1787759067.487441:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600995640064 00000100:00100000:1.0:1787759067.487445:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600995640064 00000100:00100000:3.0:1787759067.487474:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787759067.487482:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1874600995640192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759067.487538:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1874600995640192:12345-0@lo:400:kworker.0 Request processed in 57us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759067.487545:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787759067.487579:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3444:1874600995640192:0@lo:400:kworker.0 00000100:00080000:0.0:1787759067.487616:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787759067.487705:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787759067.487713:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1874600995640064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759067.487750:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1874600995640064:12345-0@lo:400:kworker.0 Request processed in 39us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759067.487756:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787759067.487823:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88b2fe232d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3444:1874600995640064:0@lo:400:kworker.0 00010000:00010000:1.0:1787759067.546072:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759067.874528:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787759067.874659:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972529024 00000100:00100000:3.0:1787759067.874669:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972529024 00000100:00100000:3.0:1787759067.874740:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 235 00000100:00100000:3.0:1787759067.874751:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+9:5458:x1874600972529024:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787759067.874769:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759067.874788:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b2e350c600/0x1a77009127f0528e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd1a7b4edcc5334e9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759067.875000:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b2e350c600/0x1a77009127f0528e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334e9 expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759067.875015:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b2e350c600/0x1a77009127f0528e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334e9 expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759067.875024:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2e350c600, rc 0) 00000100:00100000:3.0:1787759067.875093:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5458:x1874600972529024:12345-192.168.204.33@tcp:101:ll_cfg_requeue.0 Request processed in 344us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759067.875100:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 235 00000100:00100000:3.0:1787759067.878105:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787759067.878199:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972529152 00000100:00100000:0.0:1787759067.878208:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972529152 00000100:00100000:0.0:1787759067.878264:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 236 00000100:00100000:0.0:1787759067.878275:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5458:x1874600972529152:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759067.878419:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5458:x1874600972529152:12345-192.168.204.33@tcp:501:ll_cfg_requeue.0 Request processed in 145us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759067.878435:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 236 00000100:00100000:3.0:1787759067.884328:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787759067.884680:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972529280 00000100:00100000:1.0:1787759067.884699:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972529280 00000100:00100000:1.0:1787759067.884756:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 237 00000100:00100000:1.0:1787759067.884767:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5458:x1874600972529280:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759067.884922:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:5458:x1874600972529280:12345-192.168.204.33@tcp:503:ll_cfg_requeue.0 Request processed in 156us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759067.884931:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 237 00010000:00010000:0.0:1787759068.570543:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759068.833287:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787759068.833431:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972529408 00000100:00100000:0.0:1787759068.833441:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972529408 00000100:00100000:0.0:1787759068.833498:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 238 00000100:00100000:0.0:1787759068.833507:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2cf2ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2363:x1874600972529408:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:0.0:1787759068.833576:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2cf2ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c9fe673-2cdb-44ef-bded-a7cbd520bfb9+10:2363:x1874600972529408:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 70us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759068.833583:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 238 00000100:00100000:0.0:1787759068.834171:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787759068.834232:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972529536 00000100:00100000:3.0:1787759068.834236:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972529536 00000100:00100000:3.0:1787759068.834282:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 102 00000100:00100000:3.0:1787759068.834291:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2363:x1874600972529536:12345-192.168.204.33@tcp:400:kworker.0 00000100:00100000:3.0:1787759068.834328:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2363:x1874600972529536:12345-192.168.204.33@tcp:400:kworker.0 Request processed in 39us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759068.834335:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 102 00000100:00080000:0.0:1787759068.834437:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787759069.539013:0:11866:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787759069.594099:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759070.618315:0:6955:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759071.642386:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787759072.239594:0:12015:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-compr: finish setup 11:44:31 (1787759071) === 00000100:00100000:0.0:1787759072.360594:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:0.0:1787759072.360652:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:2.0:1787759072.360681:0:5962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972529792 00000100:00100000:2.0:1787759072.360696:0:5962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972529792 00000100:00100000:1.0:1787759072.360736:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972529664 00000100:00100000:1.0:1787759072.360741:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972529664 00000100:00100000:1.0:1787759072.360785:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:1.0:1787759072.360799:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e4aa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+7:2364:x1874600972529664:12345-192.168.204.33@tcp:41:mkdir.0 00000100:00080000:0.0:1787759072.360860:0:5949:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787759072.360867:0:5962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:2.0:1787759072.360878:0:5962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fef3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2fdb7338-6109-4f60-9752-fc8ea99264a4+7:9798:x1874600972529792:12345-192.168.204.33@tcp:700:mkdir.0 00000004:00000024:1.0:1787759072.360929:0:5953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1787759072.360964:0:5962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fef3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2fdb7338-6109-4f60-9752-fc8ea99264a4+7:9798:x1874600972529792:12345-192.168.204.33@tcp:700:mkdir.0 Request processed in 88us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759072.360974:0:5962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 0 00000100:00100000:1.0:1787759072.361115:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e4aa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:2364:x1874600972529664:12345-192.168.204.33@tcp:41:mkdir.0 Request processed in 320us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759072.361122:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 10 00000100:00100000:3.0:1787759072.362925:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787759072.363338:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972530048 00000100:00100000:1.0:1787759072.363362:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972530048 00000100:00100000:3.0:1787759072.363605:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 11 00000100:00100000:3.0:1787759072.363617:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe2330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:9798:x1874600972530048:12345-192.168.204.33@tcp:36:mkdir.0 00010000:00010000:3.0:1787759072.363673:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759072.363733:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b2e350da00/0x1a77009127f051a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334cd expref: 6 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.363762:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b2d6ae8700) 00010000:00010000:3.0:1787759072.363775:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787759072.363922:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7800/0x1a77009127f05295 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.363936:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7800/0x1a77009127f05295 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.363946:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7800/0x1a77009127f05295 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.363959:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7c00/0x1a77009127f0529c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.363966:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7c00/0x1a77009127f0529c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.363973:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7c00/0x1a77009127f0529c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787759072.364612:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787759072.364622:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7800/0x1a77009127f05295 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.364630:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7800/0x1a77009127f05295 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.364637:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7800/0x1a77009127f05295 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.364643:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c13f7800 already unused, calling callback (ffffffffc1a744f0) 00010000:00010000:3.0:1787759072.364652:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7800/0x1a77009127f05295 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.364660:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7800/0x1a77009127f05295 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.364670:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b2d6ae8d00) 00010000:00010000:3.0:1787759072.364673:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787759072.364676:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7800/0x1a77009127f05295 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.364683:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7800/0x1a77009127f05295 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787759072.364697:0:5954:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdfaa80f reply state 000000001195ccf7 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7c00/0x1a77009127f0529c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759072.364706:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787759072.364800:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe2330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fdb7338-6109-4f60-9752-fc8ea99264a4+7:9798:x1874600972530048:12345-192.168.204.33@tcp:36:mkdir.0 Request processed in 1185us (1877us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787759072.364808:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 11 00010000:00010000:2.0:1787759072.366198:0:3427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7c00/0x1a77009127f0529c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759072.366212:0:3427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7c00/0x1a77009127f0529c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759072.366221:0:3427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7c00/0x1a77009127f0529c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759072.366227:0:3427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c13f7c00 already unused, calling callback (ffffffffc1a744f0) 00010000:00010000:2.0:1787759072.366231:0:3427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7c00/0x1a77009127f0529c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759072.366239:0:3427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7c00/0x1a77009127f0529c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759072.366251:0:3427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88b2d6ae8b00) 00010000:00010000:2.0:1787759072.366254:0:3427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787759072.366259:0:3427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7c00/0x1a77009127f0529c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759072.366265:0:3427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7c00/0x1a77009127f0529c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759072.375405:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787759072.375486:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972530176 00000100:00100000:1.0:1787759072.375497:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972530176 00000100:00100000:1.0:1787759072.375557:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:1.0:1787759072.375567:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2fe231e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+6:9799:x1874600972530176:12345-192.168.204.33@tcp:101:chmod.0 00010000:00010000:1.0:1787759072.375589:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759072.375620:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4ce600/0x1a77009127f052a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1a7b4edcc5334f0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.375760:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cea00/0x1a77009127f052aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.375774:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cea00/0x1a77009127f052aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.375787:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cea00/0x1a77009127f052aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787759072.375831:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787759072.375879:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787759072.376099:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cea00/0x1a77009127f052aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.376137:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4ce600/0x1a77009127f052a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334f0 expref: 8 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.376154:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cea00/0x1a77009127f052aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334f0 expref: 7 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.376162:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b2c55cc300) 00010000:00010000:1.0:1787759072.376165:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787759072.376168:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2fe4cea00, rc 0) 00000100:00100000:1.0:1787759072.376262:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2fe231e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+7:9799:x1874600972530176:12345-192.168.204.33@tcp:101:chmod.0 Request processed in 697us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759072.376270:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 12 00000100:00100000:0.0:1787759072.378759:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787759072.378913:0:8028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972530432 00000100:00100000:1.0:1787759072.378922:0:8028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972530432 00000100:00100000:1.0:1787759072.378974:0:8028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 13 00000100:00100000:1.0:1787759072.378995:0:8028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e3a03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fdb7338-6109-4f60-9752-fc8ea99264a4+7:9799:x1874600972530432:12345-192.168.204.33@tcp:36:chmod.0 00010000:00010000:1.0:1787759072.379047:0:8028:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787759072.379070:0:8028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cea00/0x1a77009127f052aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334f0 expref: 7 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.379087:0:8028:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b2c55cc300) 00010000:00010000:1.0:1787759072.379099:0:8028:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787759072.379126:0:8028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cec00/0x1a77009127f052b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.379154:0:8028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cec00/0x1a77009127f052b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.379165:0:8028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cec00/0x1a77009127f052b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8028 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787759072.379362:0:8028:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f110698 reply state 000000009b8e24d5 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cec00/0x1a77009127f052b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8028 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759072.379372:0:8028:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787759072.379380:0:8028:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787759072.379464:0:8028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e3a03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fdb7338-6109-4f60-9752-fc8ea99264a4+8:9799:x1874600972530432:12345-192.168.204.33@tcp:36:chmod.0 Request processed in 482us (711us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787759072.379472:0:8028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 13 00010000:00010000:1.0:1787759072.381081:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cec00/0x1a77009127f052b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.381095:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cec00/0x1a77009127f052b1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.381103:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cec00/0x1a77009127f052b1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.381109:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2fe4cec00 already unused, calling callback (ffffffffc1a744f0) 00010000:00010000:1.0:1787759072.381114:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cec00/0x1a77009127f052b1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.381121:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cec00/0x1a77009127f052b1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.381134:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b2c55ccf00) 00010000:00010000:1.0:1787759072.381145:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787759072.381150:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cec00/0x1a77009127f052b1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8028 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.381156:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cec00/0x1a77009127f052b1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8028 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759072.397013:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787759072.397220:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972530560 00000100:00100000:3.0:1787759072.397232:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972530560 00000100:00100000:3.0:1787759072.397339:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:3.0:1787759072.397361:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2e36da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+7:9800:x1874600972530560:12345-192.168.204.33@tcp:101:chown.0 00010000:00010000:3.0:1787759072.397391:0:5955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759072.397424:0:5955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7800/0x1a77009127f052b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1a7b4edcc5334f7 expref: -99 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.397520:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7a00/0x1a77009127f052bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.397541:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7a00/0x1a77009127f052bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.397564:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7a00/0x1a77009127f052bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787759072.397606:0:5955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787759072.397610:0:5955:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787759072.397648:0:5955:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7a00/0x1a77009127f052bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.397676:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7800/0x1a77009127f052b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334f7 expref: 9 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.397696:0:5955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7a00/0x1a77009127f052bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334f7 expref: 8 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.397705:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b2d6ae8d00) 00010000:00010000:3.0:1787759072.397708:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787759072.397712:0:5955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c13f7a00, rc 0) 00000100:00100000:3.0:1787759072.397779:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2e36da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fdb7338-6109-4f60-9752-fc8ea99264a4+8:9800:x1874600972530560:12345-192.168.204.33@tcp:101:chown.0 Request processed in 430us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759072.397787:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 14 00000100:00100000:0.0:1787759072.399944:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:3.0:1787759072.400058:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972530688 00000100:00100000:3.0:1787759072.400067:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972530688 00000100:00100000:3.0:1787759072.400167:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:3.0:1787759072.400176:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fdb7338-6109-4f60-9752-fc8ea99264a4+8:9800:x1874600972530688:12345-192.168.204.33@tcp:101:chown.0 00010000:00010000:3.0:1787759072.400192:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759072.400207:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f6a00/0x1a77009127f052c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1a7b4edcc5334fe expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400258:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7e00/0x1a77009127f052cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400271:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7e00/0x1a77009127f052cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400281:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7e00/0x1a77009127f052cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400308:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7200/0x1a77009127f052d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400319:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7200/0x1a77009127f052d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400326:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7200/0x1a77009127f052d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400397:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f6600/0x1a77009127f052db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400506:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f6600/0x1a77009127f052db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400515:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f6600/0x1a77009127f052db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787759072.400626:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787759072.400630:0:5954:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787759072.400647:0:5954:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f6600/0x1a77009127f052db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400659:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7e00/0x1a77009127f052cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400665:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7e00/0x1a77009127f052cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400672:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7e00/0x1a77009127f052cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400678:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c13f7e00 already unused, calling callback (ffffffffc1a744f0) 00010000:00010000:3.0:1787759072.400682:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7e00/0x1a77009127f052cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400689:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7e00/0x1a77009127f052cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400700:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b2d6ae8d00) 00010000:00010000:3.0:1787759072.400703:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787759072.400708:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7e00/0x1a77009127f052cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400714:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7e00/0x1a77009127f052cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400726:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7200/0x1a77009127f052d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400742:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7200/0x1a77009127f052d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400748:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7200/0x1a77009127f052d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400753:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b2c13f7200 already unused, calling callback (ffffffffc1a744f0) 00010000:00010000:3.0:1787759072.400757:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7200/0x1a77009127f052d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400764:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7200/0x1a77009127f052d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400772:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88b2d6ae8700) 00010000:00010000:3.0:1787759072.400774:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787759072.400777:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7200/0x1a77009127f052d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400783:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f7200/0x1a77009127f052d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400813:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f6a00/0x1a77009127f052c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334fe expref: 10 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400828:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f6600/0x1a77009127f052db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334fe expref: 9 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759072.400835:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88b2d6ae8000) 00010000:00010000:3.0:1787759072.400922:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787759072.400930:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b2c13f6600, rc 0) 00000100:00100000:2.0:1787759072.401092:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88b2febed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fdb7338-6109-4f60-9752-fc8ea99264a4+9:9800:x1874600972530688:12345-192.168.204.33@tcp:101:chown.0 Request processed in 915us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759072.401105:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.33@tcp, seq: 15 00000100:00100000:0.0:1787759072.403899:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.33@tcp (source: 12345-192.168.204.33@tcp) 00000100:00100000:1.0:1787759072.404034:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874600972530944 00000100:00100000:1.0:1787759072.404044:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874600972530944 00000100:00100000:1.0:1787759072.404093:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.33@tcp, seq: 16 00000100:00100000:1.0:1787759072.404103:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88b2febef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fdb7338-6109-4f60-9752-fc8ea99264a4+9:9800:x1874600972530944:12345-192.168.204.33@tcp:36:chown.0 00010000:00010000:1.0:1787759072.404157:0:5953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787759072.404178:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b2c13f6600/0x1a77009127f052db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.33@tcp remote: 0xd1a7b4edcc5334fe expref: 9 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.404196:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88b2d6ae8000) 00010000:00010000:1.0:1787759072.404205:0:5953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787759072.404229:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cec00/0x1a77009127f052e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.404241:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cec00/0x1a77009127f052e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759072.404250:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b2fe4cec00/0x1a77009127f052e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 Debug log: 8466 lines, 8466 kept, 0 dropped, 0 bad.